Eric Marchand’s research while affiliated with French National Centre for Scientific Research and other places


Ad

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (260)


IROS22_1388_VI_i.mp4
  • Data
  • File available

August 2024

·

4 Reads

·

·

Eric Marchand

·

Download


QP-based Visual Servoing Under Motion Blur-Free Constraint

August 2024

·

55 Reads

IEEE Robotics and Automation Letters

This work proposes a QP-based visual servoing scheme for limiting motion blur during the achievement of a visual task. Unlike traditional image restoration approaches, we want to avoid any deconvolution step by keeping the image sequence acquired by the camera as sharp as possible. To do so, we select the norm of the image gradient as sharpness metric, from which we design a velocity constraint that is injected in a QP controller. Our system is evaluated for an Earth observation satellite. Simulation and experimental results show the effectiveness of our approach.





JAWS: Just A Wild Shot for Cinematic Transfer in Neural Radiance Fields

March 2023

·

14 Reads

This paper presents JAWS, an optimization-driven approach that achieves the robust transfer of visual cinematic features from a reference in-the-wild video clip to a newly generated clip. To this end, we rely on an implicit-neural-representation (INR) in a way to compute a clip that shares the same cinematic features as the reference clip. We propose a general formulation of a camera optimization problem in an INR that computes extrinsic and intrinsic camera parameters as well as timing. By leveraging the differentiability of neural representations, we can back-propagate our designed cinematic losses measured on proxy estimators through a NeRF network to the proposed cinematic parameters directly. We also introduce specific enhancements such as guidance maps to improve the overall quality and efficiency. Results display the capacity of our system to replicate well known camera sequences from movies, adapting the framing, camera parameters and timing of the generated video clip to maximize the similarity with the reference clip.


Skeleton Disk-Graph Roadmap: A Sparse Deterministic Roadmap For Safe 2D Navigation and Exploration

January 2023

·

18 Reads

·

4 Citations

IEEE Robotics and Automation Letters

In this letter, we describe a novel roadmap construction method in unknown environments, which relies on the extraction of the Hamilton-Jacobi skeleton of the free space. This skeleton is used to construct a graph of free-space bubbles, effectively compressing the skeleton information in a sparse data structure but retaining its topology. The bubbles also enforce safety directly in the roadmap structure. We first demonstrate the relevance of this approach for standard path-planning tasks. We also propose a frontiers-based exploration strategy able to autonomously and safely build a complete 2D map of the environment.



Fig. 1. Push-broom and starer technologies
Fig. 3. The three visual features to be regulated
Vision-based rotational control of an agile observation satellite

October 2022

·

254 Reads

·

1 Citation

To cite this version: Maxime Robic, Renaud Fraisse, Eric Marchand, François Chaumette. Vision-based rotational control of an agile observation satellite. Abstract-Recent Earth observation satellites are now equipped with new instrument that allows image feedback in real-time. Problematic such as ground target tracking, moving or not, can now be addressed by precisely controlling the satellite attitude. In this paper, we propose to consider this problem using a visual servoing approach. While focusing on the target, the control scheme has also to take into account the satellite motion induced by its orbit, Earth rotational velocities, potential target own motion, but also rotational velocities and accelerations constraints of the system. We show the efficiency of our system using both simulation (considering real Earth image) and experiments on a robot that replicates actual high resolution satellite constraints.


Ad

Citations (75)


... For real-world deployment, a consistent and accurate estimation module is essential. Dynamic SLAM frameworks [7]- [9] provide a promising solution by converting raw sensor inputs into precise pose and motion estimations, forming the foundation for trajectory forecasting. Unlike the dataset provided ground-truth data that undergoes extensive preprocessing within the dataset as well as often before each prediction model individual training, accurate dynamic SLAM outputs are generated directly from sensor measurements, reducing latency and avoiding the errors introduced during pre-processing. ...

Reference:

Training Trajectory Predictors Without Ground-Truth Data
TwistSLAM++: Fusing Multiple Modalities for Accurate Dynamic Semantic SLAM
  • Citing Conference Paper
  • October 2023

... Of particular relevance to our work are [23,12,24,28]. These approaches also consider spherical safe space representations, computed by keeping track of obstacle points [12,23,28] or a distance transformation of occupancy grid [24], coupled with specialized sampling strategies. ...

Skeleton Disk-Graph Roadmap: A Sparse Deterministic Roadmap For Safe 2D Navigation and Exploration
  • Citing Article
  • January 2023

IEEE Robotics and Automation Letters

... This offers significant advantages in cinematography: (1) enabling smooth camera movement without requiring gimbals or dollies; (2) supporting virtual re-shoots, thus eliminating the need for expensive in-person re-shoots; (3) producing slow-motion effects without requiring special equipment; (4) altering scene geometry and aesthetics without manual intervention, reducing the burden on visual effects and compositing artists He et al. 2024;Kuang et al. 2023;Song et al. 2023b;Yuan et al. 2022]; and (5) introducing/correcting camera-based artefacts like de-blurring [Wang et al. 2023d] and lens distortions Moreau et al. 2022;Xian et al. 2023]. More creative uses have also been explored, like cinematic style transfer [Wang et al. 2023a], the discovery of new cinematographic shots [Skartados et al. 2024] and modeling live sport for action-replay [Lewin et al. 2023]. In Figure 1, we demonstrate this by training a static NeRF toy scene using only 36 images to synthesize a fly-through shot that would otherwise require special equipment. ...

JAWS: Just A Wild Shot for Cinematic Transfer in Neural Radiance Fields
  • Citing Conference Paper
  • June 2023

... While effective in controlled settings, these classical methods show limited robustness to image perturbations and typically require exact target object instances. Recent learning-based approaches attempt to address these limitations through different strategies such as pose regression [9], velocity regression [10], learned feature extraction [11], metric learning [12], and unsupervised feature learning [13], [14], [5], [15]. However, these methods introduce new challenges -they require task-specific training, extensive data generation, or predefined object models, making them difficult to deploy in real-world scenarios where unseen objects and environmental changes are common. ...

Deep metric learning for visual servoing: when pose and image meet in latent space
  • Citing Conference Paper
  • May 2023

... SphereMap [16] builds a roadmap for UAV exploration in subterranean environments by sampling spherical segments. A roadmap for exploration of mobile robots can be built by sampling disks and connecting them with a visibility graph [17]. We do not consider these methods in our evaluation, because they are optimized for area coverage of a sensor or for exploration, not for path planning. ...

Disk-Graph Probabilistic Roadmap: Biased Distance Sampling for Path Planning in a Partially Unknown Environment
  • Citing Conference Paper
  • October 2022

... Utilizing semantic data is another topic that attracted great attention in recent years. Gonzalez et al. [17] presented S 3 LAM, a monocular approach based on ORB-SLAM 2.0 [18] that uses semantic segmentation of generic objects and structures. Their approach fits a plane using the triangulated 3D points for each a priori planar cluster and uses a CNN-based panoptic segmentation framework titled Detectron2 [19]. ...

S 3 LAM: Structured Scene SLAM
  • Citing Conference Paper
  • October 2022

... This system can be seen as a pinhole camera in a pan-tilt configuration subject to external motions induced by satellite orbit. Pan-tilt motion control using classical VS [30], [12], [18] may lead to motion-blurred images (see Fig. 1). We propose in this paper to constrain the camera rotational velocity using a Quadratic Programming (QP) scheme for limiting motion blur as much as possible while the satellite performs its task. ...

Vision-based rotational control of an agile observation satellite

... Qiu et al. introduced rigid and motion constraints to model articulated objects on the basis of dynamic rigid object tracking, achieving self-positioning, rigid object tracking and articulated object tracking [30]. The constrained SLAM in dynamic environment (TwistSLAM) proposed by Gonzalez et al. created point clusters based on the semantic classes of dynamic objects [31]. Jointly estimated the pose between moving objects and cameras by constructing inter-cluster constraints of semantic classes. ...

TwistSLAM: Constrained SLAM in Dynamic Environment
  • Citing Article
  • May 2022

IEEE Robotics and Automation Letters

... In contrast, the second method minimizes the distance between a data point and the corresponding model point plane, which is perpendicular to its normal plane. Generally, distance point-to-plane minimization converges faster and with greater accuracy, but not necessarily a better region of convergence [11]. ...

Plane-based Accurate Registration of Real-world Point Clouds
  • Citing Conference Paper
  • October 2021

... On the other hand, some researchers have tried to obtain more robust image features [11][12][13] for VSLAM to overcome the adverse effects caused by insufficient illumination. Further, some researchers [12,14,15] have extensively researched low-illumination VSLAM and explored the effective combination of image enhancement algorithms and VSLAM systems. However, most low-light VSLAM systems are designed for low-light environments with artificial light, and there is a lack of research on dark night scenes without artificial light. ...

Binary Graph Descriptor for Robust Relocalization on Heterogeneous Data
  • Citing Article
  • January 2022

IEEE Robotics and Automation Letters