James A. Sethian’s research while affiliated with Lawrence Berkeley National Laboratory and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (218)


RhizoNet: proposed pipeline for root segmentation and root biomass estimation from time-resolved EcoFAB images.
Root biomass: comparison between root weight (measured by a human with a scale), root area calculated from images (annotated manually by humans) and RhizoNet predictions; the colors indicate different media type for each plant in Exp 2; different symbols indicate different methods for the calculation of root biomass, shown in the legend under “value type”.
Comparative analysis of 6 unseen images from Exp 2 using three RhizoNet versions. Column 1: Raw images; Column 2: Hand-annotated images; Column 3: Predictions from Model patch 64; Column 4: Predictions from Model patch 128; Column 5: Predictions from Model patch 256.
Training patch sample: raw input image at the bottom and annotations at the top, with varying patch sizes, increasing from the left to right, corresponding to 64 × 64, 128 × 128, 256 × 256 and full size 3000 × 2039 pixels.
Building blocks of the Residual U-Net architecture with (left image) in (a), plain neural unit used in a standard U-Net and (b), a residual unit with identity mapping and (right image) the full U-Net architecture with Encoder–Decoder components.

+2

RhizoNet segments plant roots to assess biomass and growth for enabling self-driving labs
  • Article
  • Full-text available

June 2024

·

44 Reads

·

2 Citations

Zineb Sordo

·

Peter Andeer

·

James Sethian

·

[...]

·

Daniela Ushizima

Flatbed scanners are commonly used for root analysis, but typical manual segmentation methods are time-consuming and prone to errors, especially in large-scale, multi-plant studies. Furthermore, the complex nature of root structures combined with noisy backgrounds in images complicates automated analysis. Addressing these challenges, this article introduces RhizoNet, a deep learning-based workflow to semantically segment plant root scans. Utilizing a sophisticated Residual U-Net architecture, RhizoNet enhances prediction accuracy and employs a convex hull operation for delineation of the primary root component. Its main objective is to accurately segment root biomass and monitor its growth over time. RhizoNet processes color scans of plants grown in a hydroponic system known as EcoFAB, subjected to specific nutritional treatments. The root detection model using RhizoNet demonstrates strong generalization in the validation tests of all experiments despite variable treatments. The main contributions are the standardization of root segmentation and phenotyping, systematic and accelerated analysis of thousands of images, significantly aiding in the precise assessment of root growth dynamics under varying plant conditions, and offering a path toward self-driving labs.

Download


Rhizonet: Image Segmentation for Plant Root in Hydroponic Ecosystem

November 2023

·

10 Reads

Digital cameras have the ability to capture daily images of plant roots, allowing for the estimation of root biomass. However, the complexities of root structures and noisy image backgrounds pose challenges for advanced phenotyping. Manual segmentation methods are laborious and prone to errors, which hinders experiments involving several plants. This paper introduces Rhizonet, a supervised deep learning approach for semantic segmentation of plant root images. Rhizonet harnesses a Residual U-Net backbone to enhance prediction accuracy, incorporating a convex hull operation to precisely outline the largest connected component. The primary objective is to accurately segment the biomass of the roots and analyze their growth over time. The input data comprises color images of various plant samples within a hydroponic environment known as EcoFAB, subject to specific nutrition treatments. Validation tests demonstrate the robust generalization of the model across experiments.



Fig. 1. Rotary bell atomization. (A) Electrostatic rotary bell atomizers are frequently used in industrial spray painting operations because of the high transfer efficiency and quality finish it provides. (B) Close-up of a typical bell. Paint is delivered behind the central distributor plate (black) and subsequently sheets across the rapidly rotating interior surface. (C and D) Pulsed laser illumination images of atomization at the bell edge. Atomization effectiveness is controlled in part by the bell rotation speed (indicated in rpm) and fluid delivery rate (cm 3 per minute) as well as the material properties of the paint.
Fig. 3. Rotary bell atomization of Newtonian fluids. (A) Snapshot of numerical results. Liquid (blue) travels up the inside surface of the bell and over its beveled edge (shaded); after breaking apart, liquid droplets travel downstream to the right; the upward drift of the droplets as they fly away from the bell edge, as seen in the side-on view (Inset), is driven by shaping air currents. (B) Numerical and experimental volume-weighted droplet size distribution. (C) Maximal extensional strain rate on a logarithmic scale. (The gas phase is excluded from visualization.)
Fig. 4. Sheeting characteristics resulting from variations in inflow film thickness. (A) Reference example in which no variations in film thickness occur. (B-F ) Example results for three Newtonian and two shear-thinning liquids. Here, a sinusoidal variation of equal amplitude is prescribed in the inflow film thickness on the interior of the bell; the degree to which this variation is dampened or amplified on the beveled edge depends on the viscosity. Note: All six examples, (A-F ), apply the same process conditions, in particular, a fluid delivery rate of 300 ccm and bell speed 30 krpm. (G) Temporal sequence showing the detachment of a large droplet from the end of a filament; the time delta between frames is indicated. (H) High-speed imaging of atomizing butanediol; 300 ccm and bell speed 30 krpm, each frame is 3 mm by 3 mm.
Fig. 5. Impact of the effective fluid viscosity on droplet composition. Volumeweighted droplet distribution of primary (green curve) and secondary (blue curve) droplets, whose combined total (black curve) is normalized to have unit integral. In each case, the percentage figures in parentheses indicate how many of the final-surviving droplets are of secondary type. (A) and (C): Butanediol and a Newtonian liquid of viscosity four times larger, respectively, at a fluid delivery rate of 300 ccm and bell rotation speed 30 krpm. (B) and (D) Two shear-thinning liquids, in which the second is more rapidly thinning but higher effective viscosity than the first, at a fluid delivery rate of 300 ccm and bell rotation speed 45 krpm.
Insights from high-fidelity modeling of industrial rotary bell atomization

January 2023

·

173 Reads

·

6 Citations

Proceedings of the National Academy of Sciences

The global automotive industry sprayed over 2.6 billion liters of paint in 2018, much of which through electrostatic rotary bell atomization, a highly complex process involving the fluid mechanics of rapidly rotating thin films tearing apart into micrometer-thin filaments and droplets. Coating operations account for 65% of the energy usage in a typical automotive assembly plant, representing 10,000s of gigawatt-hours each year in the United States alone. Optimization of these processes would allow for improved robustness, reduced material waste, increased throughput, and significantly reduced energy usage. Here, we introduce a high-fidelity mathematical and algorithmic framework to analyze rotary bell atomization dynamics at industrially relevant conditions. Our approach couples laboratory experiment with the development of robust non-Newtonian fluid models; devises high-order accurate numerical methods to compute the coupled bell, paint, and gas dynamics; and efficiently exploits high-performance supercomputing architectures. These advances have yielded insight into key dynamics, including i) parametric trends in film, sheeting, and filament characteristics as a function of fluid rheology, delivery rates, and bell speed; ii) the impact of nonuniform film thicknesses on atomization performance; and iii) an understanding of spray composition via primary and secondary atomization. These findings result in coating design principles that are poised to improve energy- and cost-efficiency in a wide array of industrial and manufacturing settings.



Fig. 1. Cryo-ET reveals the organization of subcellular organelles in the apical complex upon ionophore-stimulation. (A) Cartoon of the Toxoplasma tachyzoite cell as well as an enlarged cartoon of the apical complex showing key subcellular structures: preconoidal rings (PCR; brown), conoid fibrils (CF; purple), intra-conoidal microtubules (IMT; blue), micronemes (green), rhoptries (red) and apical vesicles (AV; yellow). (B) Tomographic slices of a representative apical complex of nonstimulated tachyzoite showing the preconoidal rings (brackets), conoid fibrils (arrows), micronemes (M), rhoptries (R), IMT-associated AVs (AV), and the most anterior AV (asterisk).
Fig. 2. An apical vesicle is located underneath the rosette in Toxoplasma gondii tachyzoites and Plasmodium falciparum merozoites. (A) Left panel is a tomographic slice showing a top view of the rosette of a Toxoplasma tachyzoite. Right panel is a different z-slice from the same tomogram showing the anterior apical vesicle (AV) and the preconoidal rings (arrows). The dashed squares mark the same area in the tomographic slice showing that the AV is positioned about 25 nm underneath the rosette. (B) As for (A) except the tomogram showing the rosette, AV, and two (out of three) polar rings of a Plasmodium falciparum merozoite. Scale bar, 50 nm.
Fig. 3. Annotation of distinct elements in the apical complex of Toxoplasma tachyzoites using a mixed-scale dense neural network. (A) A representative slice from a tomogram that was not used in the training data and that is shown annotated in (B) and (C). Scale bar, 200 nm. (B) Annotation produced by the neural network after different iterative rounds of training (see results section for details) overlaid on the tomographic slice from (A) showing the AVs (yellow), rhoptries and micronemes (red), and microtubules (blue). Note the small but marked improvement in the annotation accuracy of the AVs, rhoptry, and IMT with each additional training as pointed by the arrows. (C) Manual correction (cyan) of the NN annotation after training #3. A zoomed-in view of the square in the left panel is shown in the right panel. Scale bar for the zoomed-in view, 50 nm.
Figure 5. Densities partially surrounding the AVs. (A) Left panel is a tomographic slice showing a density partially surrounding the anteriorly located AV in an ionophore-stimulated tachyzoite. Scale bar, 200 nm. Right panel is zoomed in
Cryo-electron tomography with mixed-scale dense neural networks reveals key steps in deployment of Toxoplasma invasion machinery

September 2022

·

156 Reads

·

22 Citations

PNAS Nexus

Host cell invasion by intracellular, eukaryotic parasites within the phylum Apicomplexa, is a remarkable and active process involving the coordinated action of apical organelles and other structures. To date, capturing how these structures interact during invasion has been difficult to observe in detail. Here, we used cryogenic electron tomography to image the apical complex of Toxoplasma gondii tachyzoites under conditions that mimic resting parasites and those primed to invade through stimulation with calcium ionophore. Through the application of Mixed Scale Dense networks for image-processing, we developed a highly efficient pipeline for annotation of tomograms, enabling us to identify and extract densities of relevant subcellular organelles and accurately analyze features in 3D. The results reveal a dramatic change in the shape of the anteriorly located apical vesicle upon its apparent fusion with a rhoptry, that occurs only in the stimulated parasites. We also present information indicating that this vesicle originates from the vesicles that parallel the intraconoidal microtubules and that the latter two structures are linked by a novel tether. We show that a rosette structure previously proposed to be involved in rhoptry secretion is associated with apical vesicles beyond just the most anterior one. This result, suggesting multiple vesicles are primed to enable rhoptry secretion, may shed light on the mechanisms Toxoplasma employs to enable repeated invasion attempts. Using the same approach, we examine Plasmodium falciparum merozoites and show that they too possess an apical vesicle just beneath a rosette, demonstrating evolutionary conservation of this overall subcellular organization.



The case for data science in experimental chemistry: examples and recommendations

April 2022

·

384 Reads

·

58 Citations

Nature Reviews Chemistry

The physical sciences community is increasingly taking advantage of the possibilities offered by modern data science to solve problems in experimental chemistry and potentially to change the way we design, conduct and understand results from experiments. Successfully exploiting these opportunities involves considerable challenges. In this Expert Recommendation, we focus on experimental co-design and its importance to experimental chemistry. We provide examples of how data science is changing the way we conduct experiments, and we outline opportunities for further integration of data science and experimental chemistry to advance these fields. Our recommendations include establishing stronger links between chemists and data scientists; developing chemistry-specific data science methods; integrating algorithms, software and hardware to ‘co-design’ chemistry experiments from inception; and combining diverse and disparate data sources into a data network for chemistry research. Modern data science can help to address challenges in experimental chemistry. This Expert Recommendation describes examples of how data science is changing the way we conduct experiments and outlines opportunities for further integration of data science and experimental chemistry to advance these fields.


Joint iterative reconstruction and 3D rigid alignment for X-ray tomography

March 2022

·

19 Reads

·

9 Citations

X-ray tomography is widely used for three-dimensional structure determination in many areas of science, from the millimeter to the nanometer scale. The resolution and quality of the 3D reconstruction is limited by the availability of alignment parameters that correct for the mechanical shifts of the sample or sample stage for the images that constitute a scan. In this paper we describe an algorithm for marker-free, fully automated and accurately aligned and reconstructed X-ray tomography data. Our approach solves the tomographic reconstruction jointly with projection data alignment based on a rigid-body deformation model. We demonstrate the robustness of our method on both synthetic phantom and experimental data and show that our method is highly efficient in recovering relatively large alignment errors without prior knowledge of a low resolution approximation of the 3D structure or a reasonable estimate of alignment parameters.


Citations (74)


... RhizoNet RhizoNet is a deep-learning based 2D-image segmentation pipeline of plant roots [14], used to automate the process of root image analysis. This pipeline consists of a 2D Residual U-Net taking as input pre-processed small size patches. ...

Reference:

An Ensemble Approach for Brain Tumor Segmentation and Synthesis
RhizoNet segments plant roots to assess biomass and growth for enabling self-driving labs

... If a multidimensional method is not used, it is very common to apply a 1D Riemann solver method dimension-by-dimension for a multi-dimensional system of hyperbolic conservation laws [4,5,10,17,27,28,163]. See some recent related development [164][165][166]. ...

A hybrid finite difference level set–implicit mesh discontinuous Galerkin method for multi-layer coating flows
  • Citing Article
  • March 2024

Journal of Computational Physics

... These works identified four crucial processes leading up to atomization -film formation, ligament formation, ligament thinning, and ligament breakup. Several articles have studied and characterized the process of film formation as paint flows along the inner surface of the bell (Tatsuya et al., 2015;Domnick et al., 2008;Kuhnhenn et al., 2018;Makarytchev et al., 1997;Symons and Bizard, 2015) and ligament formation at the edge of the bell (Rezayat and Farshchi, 2019;Shirota et al., 2012;Saye et al., 2023). In this work, ligament thinning and ligament breakup are the relevant physical processes. ...

Insights from high-fidelity modeling of industrial rotary bell atomization

Proceedings of the National Academy of Sciences

... If we interpret data as a set of noisy function evaluations of a data-generating, inaccessible, ground-truth latent function f (C a ), a GP assumes that a prior normal distribution can be placed over every finite subset of those function evaluations. This prior normal is fully defined by a prior mean and a covariance or kernel function [38]. ...

Advanced stationary and nonstationary kernel designs for domain-aware Gaussian processes
  • Citing Article
  • October 2022

Communications in Applied Mathematics and Computational Science

... have 2 in the asexual stages, and Toxoplasma spp. have 8 to 12 rhoptries [8,[17][18][19]. In P. falciparum, rhoptries are located at the apical end of the merozoite and secrete proteins that facilitate different steps during invasion. ...

Cryo-electron tomography with mixed-scale dense neural networks reveals key steps in deployment of Toxoplasma invasion machinery

PNAS Nexus

... Testing and recognizing the appeared gases is a common task for material identification [31,146,147]. The highly selective detection can be achieved by leveraging the distinct influence patterns of gases on a single sensor or array [32,[148][149][150]. Figure 12a-c indicates the response curves of different gases from 12 commercial metal oxide gas sensors [151]. It can be observed that the responses evidently vary with the gas composition and concentration, which provides a strong marker for the identification. ...

The case for data science in experimental chemistry: examples and recommendations
  • Citing Article
  • April 2022

Nature Reviews Chemistry

... However, vibrations cannot always be excluded completely and can be caused by instabilities of the equipment, i.e. precision of the motion axes, air flow, or other equipment nearby utilising a pump or cooling fan. Vibrations that can be resolved, i.e. when the frequency is sufficiently low while the exposure time of the detector is sufficiently short, can be corrected using algorithms like joint reprojection [37], phase symmetry [38], or distributed optimisation [39]. ...

Joint iterative reconstruction and 3D rigid alignment for X-ray tomography

... In contrast to g 2 which averages over τ and therefore cannot express non-equilibrium dynamics, C 2 is capable of describing any type of relaxation dynamics and provides a "fingerprint" of the nonequilibrium system at any given experimental time. A variety of analyses have been used to take advantage of both the fundamental foundation for traditional XPCS analysis and the information-rich correlations which describe changes between specific time points [12][13][14][15][15][16][17][18] , however, the amount of human adjudication required for interpretation of results from such advanced XPCS analysis methods, as well as the amount of data collected in synchrotron experiments, pose significant barriers to the development of a more quantitative physical understanding of dynamics in complex material systems. To further complicate the matter, the variety of patterns shown in experimental C 2 from a single system varies drastically such that even visual identification of relationships between data points is difficult (see Fig. 1 C and Supplemental Fig. 1 for a sample of C 2 data). ...

Cross-correlation analysis of X-ray photon correlation spectroscopy to extract rotational diffusion coefficients

Proceedings of the National Academy of Sciences

... Using the conventional peak finding algorithm based on searching local maximum would fail at heavy peak overlapping region and/or broad peaks from poor crystalline samples. Previously, neural networks have been used to classify symmetry groups, prototype structures, or phases from raw XRD patterns (9)(10)(11). Data-driven methods of phase mapping have been developed for scenarios with a sufficient number of XRD patterns (e.g., from a combinatorial library), with non-negative matrix factorization (NMF) (12) or generative adversarial network (GAN) (13). ...

Gaussian processes for autonomous data acquisition at large-scale synchrotron and neutron facilities
  • Citing Article
  • July 2021

Nature Reviews Physics

... However, the inherent smoothing of interfacial forces can lower modeling fidelity. In case of highly intricate physics, such as interfacial instabilities and breakup in a shear-dominated environment, a rigorous and exact imposition of the jumps conditions turns out to be necessary (Nourgaliev et al, 2008;Saye and Sethian, 2020). The second class includes the sharp interface methods. ...

A review of level set methods to model interfaces moving under complex physics: Recent challenges and advances
  • Citing Chapter
  • January 2020

Handbook of Numerical Analysis