Matthias Trapp

Matthias Trapp
Hasso Plattner Institute · Research Group Computer Graphics Systems

Dr. rer. nat.

About

235
Publications
83,088
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,210
Citations
Introduction
I'm a senior researcher, lecturer, and principle investigator at the HPI's Computergraphics Systems Chair. My research interests includes GPU-based image and video processing techniques and frameworks, interactive GPU-based rendering techniques for massive spatio-temporal data, focus+context visualization techniques for virtual environments, web-based visualization for mobility analytics, and interactive software maps.
Additional affiliations
October 2017 - October 2020
Hasso Plattner Institute
Position
  • Senior Researcher
June 2014 - September 2014
University of Rostock
Position
  • Visiting Researcher
April 2012 - September 2017
Hasso Plattner Institute
Position
  • Group Leader
Education
October 2000 - December 2006
Universität Potsdam
Field of study
  • Computer Science

Publications

Publications (235)
Article
Full-text available
Intrinsic decomposition refers to the problem of estimating scene characteristics, such as albedo and shading, when one view or multiple views of a scene are provided. The inverse problem setting, where multiple unknowns are solved given a single known pixel-value, is highly under-constrained. When provided with correlating image and depth data, in...
Conference Paper
Full-text available
This paper presents the concept and experience of teaching an undergraduate course on data-driven image and video processing. When designing visual effects that make use of Machine Learning (ML) models for image-based analysis or processing, the availability of training data typically represents a key limitation when it comes to feasibility and eff...
Preprint
Full-text available
We present StyleTune, a mobile app for interactive multi-level control of neural style transfers that facilitates creative adjustments of style elements and enables high output fidelity. In contrast to current mobile neural style transfer apps, StyleTune supports users to adjust both the size and orientation of style elements, such as brushstrokes...
Conference Paper
Full-text available
Various web-based image-editing tools and web-based collaborative tools exist in isolation. Research focusing to bridge the gap between these two domains is sparse. We respond to the above and develop prototype groupware for real-time collaborative editing of raster images in a web browser. To better understand the requirements, we conduct a prelim...
Conference Paper
Full-text available
This paper presents a framework for generating real-time procedural animations and morphings of 3D point clouds. Point clouds or point-based geometry of varying density can easily be acquired using LiDAR cameras or modern smartphones with LiDAR sensors. This raises the question how this raw data can directly be used in the creative industry to crea...
Preprint
Full-text available
Image-based artistic rendering can synthesize a variety of expressive styles using algorithmic image filtering. In contrast to deep learning-based methods, these heuristics-based filtering techniques can operate on high-resolution images, are interpretable, and can be parameterized according to various design aspects. However, adapting or extending...
Conference Paper
The number of publicly accessible software repositories on online platforms is growing rapidly. With more than 128 million public repositories (as of March 2020), GitHub is the world’s largest platform for hosting and managing software projects. Where it used to be necessary to merge various data sources, it is now possible to access a wealth of da...
Article
Full-text available
Various web-based image-editing tools and web-based collaborative tools exist in isolation. Research focusing to bridge the gap between these two domains is sparse. We respond to the above and develop prototype groupware for real-time collaborative editing of raster and vector images in a web browser. To better understand the requirements, we condu...
Article
Full-text available
Fast style transfer methods have recently gained popularity in art-related applications as they make a generalized real-time stylization of images practicable. However, they are mostly limited to one-shot stylizations concerning the interactive adjustment of style elements. In particular, the expressive control over stroke sizes or stroke orientati...
Conference Paper
Full-text available
Signed distance functions computed in discrete form from given RGB-D data as regular voxel grids can represent manifold shapes as the zero crossing of a trivariate function; the corresponding meshes can be derived by the Marching Cubes algorithm. However, 3D models automatically reconstructed in this way often contain irrelevant objects or artifact...
Presentation
Full-text available
Presentation of paper "Interactive Editing of Voxel-Based Signed Distance Fields" presented at the 30th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG 2022).
Conference Paper
Full-text available
The paper presents a new approach of optimized vectorization to generate stylized artifacts such as drawings with a plotter or cutouts with a laser cutter. For this, we developed a methodology for transformations between raster and vector space. More over, we identify semiotic aspects of Geometry-based Stylization Techniques (GSTs) and the combinat...
Presentation
Full-text available
Presentation of paper "Design Space of Geometry-based Image Abstraction Techniques with Vectorization Applications" presented at the 30th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG 2022).
Preprint
Full-text available
Image acquisition in low-light conditions suffers from poor quality and significant degradation in visual aesthetics. This affects the visual perception of the acquired image and the performance of various computer vision and image processing algorithms applied after acquisition. Especially for videos, the additional temporal domain makes it more c...
Conference Paper
Full-text available
Point clouds or point-based geometry of varying density can nowadays be easily acquired using LiDAR cameras or modern smartphones with LiDAR sensors. We demonstrate how this data can be used directly to create novel artistic digital content using Non-Photorealistic Rendering techniques. We introduce a GPU-based technique for art-directable NPR rend...
Conference Paper
Full-text available
In order to detect software risks at an early stage, various software visualization techniques have been developed for monitoring the structure, behaviour, or the underlying development process of software. One of greatest risks for any IT organization consists in an inappropriate distribution of knowledge among its developers, as a projects' succe...
Presentation
Full-text available
Presentation of research paper "Visualization of Knowledge Distribution across Development Teams using 2.5D Semantic Software Maps".
Presentation
Full-text available
Presentation of research paper "A Non-Photorealistic Rendering Technique for Art-directed Hatching of 3D Point Clouds".
Chapter
Acquisition and consumption of visual media such as digital image and videos is becoming one of the most important forms of modern communication. However, since the creation and sharing of images is increasing exponentially, images as a media form suffer from being devalued, as the quality of single images are getting less and less important, and t...
Article
The paper presents a new approach of optimized vectorization to generate stylized artifacts such as drawings with a plotter or cutouts with a laser cutter. For this, we developed a methodology for transformations between raster and vector space. More over, we identify semiotic aspects of Geometry-based Stylization Techniques (GSTs) and the combinat...
Presentation
Full-text available
Presentation of research paper FERMIUM: A Framework for Real-time Procedural Point Cloud Animation & Morphing at 26th International Symposium on Vision, Modeling, and Visualization (VMV 2021). Link to talk: https://www.youtube.com/watch?v=mBAiRnbZkAQ
Presentation
Full-text available
Presentation of research paper "Interactive Multi-level Stroke Control for Neural Style Transfer" at Cyberworlds 2021
Conference Paper
Full-text available
We present StyleTune, a mobile app for interactive multi-level control of neural style transfers that facilitates creative adjustments of style elements and enables high output fidelity. In contrast to current mobile neural style transfer apps, StyleTune supports users to adjust both the size and orientation of style elements, such as brushstrokes...
Presentation
Full-text available
Presentation of research paper "COLiER: Collaborative Editing of Raster Images" at Cyberworlds 2021.
Conference Paper
Full-text available
We present StyleTune, a mobile app for interactive style transfer enhancement that enables global and spatial control over stroke elements and can generate high fidelity outputs. The app uses adjustable neural style transfer (NST) networks to enable art-direction of stroke size and orientation in the output image. The implemented approach enables c...
Conference Paper
Full-text available
We present MotionViz, an interactive iOS mobile app that enables users to amplify motion and dynamics in videos. MotionViz implements novel augmented reality and expressive rendering techniques in an end-to-end processing pipeline: multi-dimensional video data is captured, analyzed, and processed to render animated graphical elements that help expr...
Conference Paper
Full-text available
Taking selfies is a common practice for smartphone users. Simultaneously capturing oneself and the desired background is not a trivial task, because it is often not possible to get a good view of both. Moreover, users often loose attention of their surroundings, thus taking a selfie also showed to lead to serious injuries. To ease the process of ca...
Preprint
Full-text available
Various web-based image-editing tools and web-based collaborative tools exist in isolation. Research focusing to bridge the gap between these two domains is sparse. We respond to the above and develop a prototype groupware for real-time collaborative editing of raster images in a web browser. To better understand the requirements, we conduct a prel...
Conference Paper
Full-text available
This paper presents a service-based approach towards content moderation of digital visual media while browsing web pages. It enables the automatic analysis and classification of possibly offensive content, such as images of violence, nudity, or surgery, and applies common image abstraction techniques at different levels of abstraction to these to l...
Presentation
Full-text available
Presentation of research paper "Service-based Analysis and Abstraction for Content Moderation of Digital Images" presented at Graphics Interface (GI 2021).
Presentation
Full-text available
Presentation of research paper "Service-based Processing of Gigapixel Images" presented at 29. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG 2021).
Presentation
Full-text available
Presentation of research paper "Interactive Photo Editing on Smartphones via Intrinsic Decomposition" presented at 42nd Annual Conference of the European Association for Computer Graphics (Eurographics’2021).
Presentation
Full-text available
Presentation of education paper "Teaching Data-driven Video Processing via Crowdsourced Data Collection" presented at 42nd Annual Conference of the European Association for Computer Graphics (Eurographics’2021).
Conference Paper
Full-text available
This paper describes an approach for using the Unity game engine for image processing by integrating a custom GPU-based image processor. It describes different application levels and integration approaches for extending the Unity game engine. It further documents the respective software components and implementation details required, and demonstrat...
Poster
Full-text available
This paper describes an approach for using the Unity game engine for image processing by integrating a custom GPU-based image processor. It describes different application levels and integration approaches for extending the Unity game engine. It further documents the respective software components and implementation details required, and demonstrat...
Presentation
Full-text available
Presentation of the research paper "Integration of Image Processing Techniques into the Unity Game Engine" at the 1st International Conference on Image Processing and Vision Engineering (IMPROVE 2021).
Presentation
Full-text available
Recent developments of mobile-device technology enable the processing of neural networks on-device using specialized hardware, e.g., so-called neural processing units. This allows for the application of neural networks directly on these devices without requiring server-based processing. However, using this hardware often requires adaptation and opt...
Conference Paper
Full-text available
With the ongoing improvement of digital cameras and smartphones, more and more people can acquire high-resolution digital images. Due to their size and high performance requirements, such Gigapixel Images (GPIs) areoften challenging to process and explore compared to conventional low resolution images. To address this problem,this paper presents a...
Conference Paper
Full-text available
With the ongoing improvement of digital cameras and smartphones, more and more people can acquire high- resolution digital images. Due to their size and high performance requirements, such Gigapixel Images (GPIs) are often challenging to process and explore compared to conventional low resolution images. To address this problem, this paper presents...
Conference Paper
Full-text available
Treemaps are a commonly used tool for the visual display and communication of tree-structured, multi-variate data. In order to confidently know when and how treemaps can best be applied, the research community uses usability studies and controlled experiments to "understand the potential and limitations of our tools" (Plaisant, 2004). To support th...
Conference Paper
Full-text available
A truthful and unbiased display of data using information visualization requires detecting and communicating uncertainty. Uncertainty is often inherent in data or is introduced by data processing and visualization (e.g., visual display of accumulated data) but frequently not accounted for. This paper discusses the suitability of advanced visual var...
Conference Paper
Full-text available
This paper presents a rendering framework for the visualization of massive point datasets in the web. It includes highly interactive point rendering, cluster visualization, basic interaction methods, and importance-based labeling, while being available for both mobile and desktop browsers. The rendering style is customizable, as shown in figure 1....
Conference Paper
Full-text available
This paper reports on an service-based approach to enable real-time stream-processing of high-resolution videos. It presents a concept for integrating black-box image and video processing operations into a streaming framework. It further describes approaches to optimize data flow between the processing implementation and the framework to increase t...
Conference Paper
Full-text available
This paper presents a new approach for the vectorization of stylized images using intermediate data representations to interface image stylization and vectorization techniques. It enables the combination of efficient GPU-based implementations of interactive image stylization techniques and the advantages of vectorized image representations. We demo...
Conference Paper
Full-text available
Automated processing, semantic-enrichment and visual analytics methods for point clouds are often use-case specific for a given domain (e.g, for Facility Management (FM) applications). Currently, this means that applicable processing techniques, semantics and visual analytics methods need to be selected, generated or implemented by human domain exp...
Presentation
Full-text available
Presentation of Research Paper "Intermediate Representations for Vectorization of Stylized Images"
Conference Paper
Full-text available
In this paper we present an approach for classifying indoor point clouds-particularly areas of clutter, noise, and missing segments that are often featured in point clouds captured using commodity mobile devices with photogrammetric or depth-sensing capabilities. We describe and evaluate two deep-learning approaches for classification of point clou...
Conference Paper
Full-text available
With the spread of smart phones capable of taking high-resolution photos and the development of high-speed mobile data infrastructure, digital visual media is becoming one of the most important forms of modern communication. With this development, however, also comes a devaluation of images as a media form with the focus becoming the frequency at w...
Conference Paper
Full-text available
A treemap is a visualization that has been specifically designed to facilitate the exploration of tree-structured data and, more general, hierarchically structured data. The family of visualization techniques that use a visual metaphor for parent-child relationships based “on the property of containment” (Johnson, 1993) is commonly referred to as t...
Presentation
Full-text available
Presentation of research paper "Controlling Image-Stylization Techniques using Eye Tracking".
Article
Full-text available
Visualization of point clouds plays an important role in understanding the context of the digital representation of the built environment. Modern commodity mobile devices (e.g., smartphones and tablets), are capable of capturing representations in the form of 3D point clouds, with their depth-sensing and photogrammetry capabilities. Points clouds e...
Conference Paper
Full-text available
Integration and analysis of real-time and historic sensor data provides important insights into the operational status of buildings. There is a need for the integration of sensor data and digital representations of the built environment for furthering stakeholder engagement within the realms of Real Estate 4.0 and Facility Management (FM), especial...
Article
Full-text available
Integration and analysis of real-time and historic sensor data provides important insights into the operational status of buildings. There is a need for the integration of sensor data and digital representations of the built environment for furthering stakeholder engagement within the realms of Real Estate 4.0 and Facility Management (FM), especial...
Article
Full-text available
Mobile expressive rendering gained increasing popularity among users seeking casual creativity by image stylization and supports the development of mobile artists as a new user group. In particular, neural style transfer has advanced as a core technology to emulate characteristics of manifold artistic styles. However, when it comes to creative expr...
Presentation
Full-text available
Presentation of research paper "Occlusion Management Techniques for the Visualization of Transportation Networks in Virtual 3D City Models".