Jiahao Weng’s research while affiliated with Japan Advanced Institute of Science and Technology and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (7)


DualSlide: Global-to-Local Sketching Interface for Slide Content and Layout Design
  • Conference Paper

June 2023

·

4 Reads

·

1 Citation

Jiahao Weng

·

Xusheng Du

·


Fig. 1. System concept of the proposed DualSlide sketching interface.
Fig. 3. Data pre-processing for slide extraction and slide contents extraction.
Fig. 5. Architecture of the font recognition model. The CNN classifier takes the output from the CAE and a number of font types as inputs.
Fig. 6. Architecture of CAE.
Fig. 7. The heat map canvas and the toolkit to change the type of heat map.

+8

DualSlide: Global-to-Local Sketching Interface for Slide Content and Layout Design
  • Preprint
  • File available

April 2023

·

74 Reads

Online learning and academic conferences have become pervasive and essential for education and professional development, especially since the onset of pandemics. Academic presentations usually require well-designed slides that are easily understood. Sketches that visually represent design intentions and are readily accessible to the average users. To assist non-expert users in creating visually appealing academic slides, we propose DualSlide, a global and local two-stage sketching interface system that provides image retrieval and user guidance. At the global stage, DualSlide provides a heat map canvas to display the distribution of all slide layouts in a dataset, allowing users to explore the reference slides efficiently. At the local stage of the system, detailed references and guidance for designing slide content, such as diagrams and fonts, can be provided. We further propose a sketch-matching algorithm to compare the user's input sketch and similar diagrams. All user guidance can be adapted in real-time editing, and users can design slides with a high degree of freedom. We conducted a user study to verify the effectiveness and usability of the proposed DualSlide system confirming that DualSlide provides high retrieval accuracy and satisfactory design results with a good user experience. Video: https://youtu.be/lUI1zjxCdM0

Download

Figure 2. The framework of our system The left part is the offline computation process for slide extraction; the middle part is the dataset collection; and the right part is the user interface.
Figure 3. The shadow guidance of the proposed drawing interface. Part 1 is the heat-map of title layout, part 2 is the heat-map of text layout, part 3 is the heat-map of figure layout, and part 4 is the heat-map of all the layout.
Figure 4. The retrieval results of layout design. The green box is the title layout, the red box is the figure layout, and the blue box is the text layout.
Figure 5. Examples of the designed results by participants during the user study.
Interactive Layout Drawing Interface with Shadow Guidance

December 2022

·

32 Reads

It is difficult to design a visually appealing layout for common users, which takes time even for professional designers. In this paper, we present an interactive layout design system with shadow guidance and layout retrieval to help users obtain satisfactory design results. This study focuses in particular on the design of academic presentation slides. The user may refer to the shadow guidance as a heat map, which is the layout distribution of our gathered data set, using the suggested shadow guidance. The suggested system is data-driven, allowing users to analyze the design data naturally. The layout may then be edited by the user to finalize the layout design. We validated the suggested interface in our user study by comparing it with common design interfaces. The findings show that the suggested interface may achieve high retrieval accuracy while simultaneously offering a pleasant user experience.


Find Your ASMR: A Perceptual Retrieval Interface for Autonomous Sensory Meridian Response Videos

October 2022

·

28 Reads

Lecture Notes in Computer Science

Autonomous sensory meridian response (ASMR) is a type of video contents designed to help people relax and feel comfortable. Users usually retrieve ASMR contents from various video websites using only keywords. However, it is challenging to examine satisfactory contents to reflect users’ needs for ASMR videos using keywords or content-based retrieval. To solve this issue, we propose a perceptual video retrieval system for ASMR videos and provide a novel retrieval user interface that allows users to retrieve content according to watching purpose and anticipated expectations, such as excitement, calmness, stress and sadness. An ASMR video perception dataset is constructed with annotations on affective responses after watching the videos. To verify the proposed video retrieval system, a user study is conducted showing that users can retrieve satisfactory ASMR contents easily and efficiently compared to conventional keywords-based retrieval systems. KeywordsASMRVideo retrievalUser interfaceUser perception



Find Your ASMR: A Perceptual Retrieval Interface for Autonomous Sensory Meridian Response Videos

May 2022

·

226 Reads

Autonomous sensory meridian response (ASMR) is a type of video contents designed to help people relax and feel comfortable. Users usually retrieve ASMR contents from various video websites using only keywords. However, it is challenging to examine satisfactory contents to reflect users' needs for ASMR videos using keywords or content-based retrieval. To solve this issue, we propose a perceptual video retrieval system for ASMR videos and provide a novel retrieval user interface that allows users to retrieve content according to watching purpose and anticipated expectations, such as excitement, calmness, stress and sadness. An ASMR video perception dataset is constructed with annotations on affective responses after watching the videos. To verify the proposed video retrieval system, a user study is conducted showing that users can retrieve satisfactory ASMR contents easily and efficiently compared to conventional keywords-based retrieval systems.


Citations (2)


... Furthermore, this approach helps users identify and address any weaknesses in their designs. In contrast to traditional keyword-based retrieval systems [15], our system can extract slides from academic presentation videos and analyze their layout using image analysis techniques. We also apply a convolutional neural network (CNN) to extract features from the slides. ...

Reference:

DualSlide: Global-to-Local Sketching Interface for Slide Content and Layout Design
HiVideo: Hierarchical Browsing Interface for Educational Videos
  • Citing Conference Paper
  • July 2022

... The common approaches for video retrieval are keyword and content-based video indexing and retrieval [10]. A hierarchical retrieval interface was proposed to explore video content through poster-style summarization [12]. A perceptionbased approach was explored to achieve the desired design using sensation words [4]. ...

Hierarchical visual interface for educational video retrieval and summarization
  • Citing Conference Paper
  • May 2022