Josh Siegel

Josh Siegel
Michigan State University | MSU · Department of Computer Science and Engineering

PhD

About

82
Publications
29,062
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,061
Citations

Publications

Publications (82)
Article
Full-text available
We identify the need for enhanced pedestrian–vehicle simulation tools and build such a tool to explore the interaction among pedestrian “players” and virtual human- and automated-vehicles for different scenarios taking place in an urban environment. We first present contemporary research tools and then propose the design and development of a new de...
Preprint
Full-text available
In a world increasingly dependent on road-based transportation, it is essential to understand vehicles. We introduce the AI mechanic, an acoustic vehicle characterization deep learning system, as an integrated approach using sound captured from mobile devices to enhance transparency and understanding of vehicles and their condition for non-expert u...
Conference Paper
Full-text available
While awareness of active threats is critical to space vehicles, action is required to avoid harm. Physical hazard avoidance requires orbital manipulation using propulsion, whereas options for avoiding or nullifying radio frequency interference (RFI) are less straightforward. Because these actions need to occur on the space vehicle in real-time des...
Article
A gamification approach for tackling waste management planning and urban development provide a more engaging and interactive experience with high pedagogical potential. Existing serious games involving waste management are complex in their data ingestion, use, and presentation, limiting individuals' opportunities to gain knowledge and decision-maki...
Article
Full-text available
Broader understanding of waste management has the potential to bring about broad societal change impacting the climate crisis and public health. We present existing waste management tools and commercially-available games involving waste management, highlighting the strengths and opportunities left unaddressed by these tools in educational contexts...
Preprint
Cyber-Physical systems (CPS) have complex lifecycles involving multiple stakeholders, and the transparency of both hardware and software components' supply chain is opaque at best. This raises concerns for stakeholders who may not trust that what they receive is what was requested. There is an opportunity to build a cyberphysical titling process of...
Article
Full-text available
Artificial Intelligence (AI) is becoming integral to human life, and the successful wide-scale uptake of autonomous and automated vehicles (AVs) will depend upon people's willingness to adopt and accept AI-based technology and its choices. A person's state of mind, a fundamental belief evolving out of an individual's character, personal choices, in...
Preprint
Full-text available
The present cross-disciplinary research explores pedestrian-autonomous vehicle interactions in a safe, virtual environment. We first present contemporary tools in the field and then propose the design and development of a new application that facilitates pedestrian point of view research. We conduct a three-step user experience experiment where par...
Article
Full-text available
We motivate the desire for self-driving and explain its potential and limitations, and explore the need for—and potential implementation of—morals, ethics, and other value systems as complementary “capabilities” to the Deep Technologies behind self-driving. We consider how the incorporation of such systems may drive or slow adoption of high automat...
Article
Full-text available
Path planning algorithms are used by mobile robots, unmanned aerial vehicles, and autonomous cars in order to identify safe, efficient, collision-free, and least-cost travel paths from an origin to a destination. Choosing an appropriate path planning algorithm helps to ensure safe and effective point-to-point navigation, and the optimal algorithm d...
Article
Full-text available
We identify the need for an easy-to-use self-driving simulator where game mechanics implicitly encourage high-quality data capture and an associated low-cost physical test platform. We design such a simulator incorporating environmental domain randomization to enhance data generalizability and a low-cost physical test platform running the Robotic O...
Article
Automated Vehicles (AVs) must comply with traffic laws, including those requiring motorists to maintain safe distances when passing pedalcyclists. We review relevant U.S. legislation, statistics of traffic accidents in the U.S. resulting in pedalcyclists fatalities, and present “what if” scenarios for AV and pedalcyclist interactions to illustrate...
Article
As automotive data increase in scale and value, it is important to understand who owns and has the ability to access information generated by connected vehicles. The plummeting costs of sensing, connectivity, and storage mean that original equipment manufacturers (OEMs), their suppliers, and end users have access to more realtime data than ever [1]...
Article
Full-text available
Automotive software is increasingly complex and critical to safe vehicle operation, and related embedded systems must remain up to date to ensure long-term system performance. Update mechanisms and data modification tools introduce opportunities for malicious actors to compromise these cyber-physical systems, and for trusted actors to mistakenly in...
Article
The term "Deep Tech" is prevalent in industry but ill-defined. In this extended letter, we define Deep Tech (technology that is difficult to develop today, with the potential to become a pervasive and easy-to-implement basic need in the future) and consider its role in evolving businesses. We suggest how organizations can position themselves to tak...
Chapter
This chapter explores the growing influence of robotics and automation on sports and potential resultant future states. In this chapter, Siegel and Morris describe advances leading to broader deployment of robotics and automation and envision how these technologies may lead to new models for spectator experience by increasing engagement and interac...
Preprint
Full-text available
We survey the state-of-the-art in offboard diagnostics for vehicles, their occupants, and environments, with particular focus on vibroacoustic approaches. We identify promising application areas including data-driven management for shared mobility and automated fleets, usage-based insurance, and vehicle,occupant, and environmental state and conditi...
Article
Full-text available
Tank-style water heaters provide a critical utility but often waste energy, as low temperatures encourage the formation of harmful bacteria. We develop low-cost hardware to capture training data from a single home’s hot water consumption and present a system capable of proactively anticipating demand while remaining sensitive to health concerns by...
Preprint
Full-text available
Automated vehicles' neural networks suffer from overfit, poor generalizability, and untrained edge cases due to limited data availability. Researchers synthesize randomized edge-case scenarios to assist in the training process, though simulation introduces potential for overfit to latent rules and features. Automating worst-case scenario generation...
Article
2020 IEEE. Generating 3D point clouds is challenging yet highly desired. This work presents a novel autoregressive model, PointGrow, which can generate diverse and realistic point cloud samples from scratch or conditioned on semantic contexts. This model operates recurrently, with each point sampled according to a conditional distribution given its...
Preprint
Full-text available
Automotive software is increasingly complex and critical to safe vehicle operation, and related embedded systems must remain up-to-date to ensure long-term system performance. Update mechanisms and data modification tools introduce opportunities for malicious actors to compromise these cyber-physical systems, and for trusted actors to mistakenly i...
Article
Full-text available
There is an opportunity to utilize wearable, consumer-oriented sensors for self-health monitoring and preventative medicine. Disposable diaper with built-in low-cost, disposable moisture sensors is one such product. Diaper users include infants, elderly, disabled individuals, and hospital patients. Event-based alerting can enhance care of this popu...
Preprint
Full-text available
We identify the need for a gamified self-driving simulator where game mechanics encourage high-quality data capture, and design and apply such a simulator to collecting lane-following training data. The resulting synthetic data enables a Convolutional Neural Network (CNN) to drive an in-game vehicle. We simultaneously develop a physical test platfo...
Article
Manufacturers struggle to produce low-cost, robust and complex components at manufacturing lot-size one. Additive processes like Fused Filament Fabrication (FFF) inexpensively produce complex geometries, but defects limit viability in critical applications. We present an approach to high-accuracy, high-throughput and low-cost automated non-destruct...
Article
Augmented Reality (AR) is known to enhance user experience, however, it remains under-adopted in industry. We present an AR interaction system improving human-machine coordination in Internet of Things (IoT) and Industry 4.0 applications including manufacturing and assembly, maintenance and safety, and other highly-interactive functions. A driver o...
Preprint
Full-text available
Manufacturers struggle to produce low-cost, robust and complex components at manufacturing lot-size one. Additive processes like Fused Filament Fabrication (FFF) inexpensively produce complex geometries, but defects limit viability in critical applications. We present an approach to high-accuracy, high-throughput and low-cost automated non-destruct...
Article
Full-text available
Conventional cybersecurity neglects the Internet of Things' physicality. We propose a "Cognitive Protection System" capable of using system models to ensure command safety while monitoring system performance, and develop and test a "Cognitive Firewall" and "Cognitive Supervisor." This system is tested in theory and practice for three threat models.
Article
Full-text available
We describe bridging IoT's air gap using device speakers to communicate with voice assistants. We recommend protecting voice channels using two-factor authentication, contextual monitoring, and voice source embedding. These techniques are necessary when connecting critical applications to open channels, and may apply to other exploits resulting fro...
Article
We present an Augmented Reality (AR) visualization and interaction tool for users to control Internet of Things (IoT) devices with hand gestures. Today, smart IoT devices are becoming increasingly ubiquitous with diverse forms and functions, yet most user controls over them are still limited to mobile devices and web interfaces. Recently, AR has be...
Article
Full-text available
At the World Economic Forum Annual Meeting 2017, global leaders highlighted the development of the internet of things (IoT) as one of the most significant emerging technologies, harbouring the potential for massive societal impact. Recognizing this opportunity, the World Economic Forum, the Auto-ID Lab at the Massachusetts Institute of Technology (...
Article
Full-text available
The Internet of Things (IoT) is a family of technologies enabling connectivity, sensing, inference, and action that is expected to comprise 30 billion devices by 2020. IoT’s meteoric growth presents opportunities for large-scale data collection and actuation. However, this growth also amplifies vulnerabilities in critical infrastructure networks an...
Conference Paper
Full-text available
This demo features a virtual 3D car model based off a vehicle's data duplicate, an IoT-enabled Avacar. There are three embodiments including a desktop application (VirtualCar), Augmented Reality (VirtualCarAR), and Virtual Reality (VirtualCarVR). The Avacar gets information from an external API serving information from a real or representative simu...
Article
When developing cyber-physical systems such as automated vehicles, safety and cybersecurity analyses are often conducted separately. However, unlike in the IT world, safety hazards and cybersecurity threats converge in cyber-physical systems; a malicious party can exploit cyber-threats to create extremely hazardous situations, whether in autonomous...
Preprint
A point cloud is an agile 3D representation, efficiently modeling an object's surface geometry. However, these surface-centric properties also pose challenges on designing tools to recognize and synthesize point clouds. This work presents a novel autoregressive model, PointGrow, which generates realistic point cloud samples from scratch or conditio...
Article
Full-text available
Purpose The purpose of this paper is to develop a model to estimate the value of information generated by and stored within vehicles to help people, businesses and researchers. Design/methodology/approach The authors provide a taxonomy for data within connected vehicles, as well as for actors that value such data. The authors create a monetary v...
Conference Paper
Full-text available
Proper tire maintenance is key to the safe and efficient operation of vehicles. Without frequent inspection, pressure can drop and tread can wear down, increasing drag and reducing traction. While modern cars make use of Tire Pressure Monitoring Systems (TPMS), these systems may only identify differential changes in pressure and older vehicles lack...
Article
Full-text available
We examine methods for detecting and disrupting electronic arc faults, proposing an approach leveraging Internet of Things connectivity, artificial intelligence, and adaptive learning. We develop Deep Neural Networks (DNNs) taking Fourier coefficients, Mel-Frequency Cepstrum data, and Wavelet features as input for differentiating normal from malign...
Chapter
Full-text available
Vehicle tires must be maintained to assure performance, efficiency, and safety. Though vehicle owners may monitor tread depth and air pressure, most are unaware of the safety risks of degrading rubber. This paper identifies the need for tire material condition monitoring and develops a densely connected convolutional neural network to identify crac...
Article
In contrast to the strict requirements of Eruchin pledges found in Leviticus 27:1–8, Damim (monetary) donations are not closely regulated by the Torah and can take many forms. One may not, for example, offer an Erech that corresponds to some fraction of a human being, as Erech donations can be made only on an integer number of persons. To use langu...
Article
Automotive engine intake filters ensure clean air delivery to the engine, though over time these filters load with contaminants hindering free airflow. Today's open-loop approach to air filter maintenance has drivers replace elements at predetermined service intervals, causing costly and potentially harmful over-and under-replacement. The result is...
Article
Full-text available
This paper summarizes the state of the art in connected vehicles--from the need for vehicle data and applications thereof, to enabling technologies, challenges, and identified opportunities. Connectivity is increasing around the world and its expansion to vehicles is no exception. With improvements in connectivity, sensing, and computation, the fut...
Article
Full-text available
The Internet of Things’ (IoT’s) rapid growth is constrained by resource use and fears about privacy and security. A solution jointly addressing security, efficiency, privacy, and scalability is needed to support continued expansion. We propose a solution modeled on human use of context and cognition, leveraging cloud resources to facilitate IoT on...
Article
Full-text available
The Internet of Things (IoT) can reduce manufacturing cost, improve uptime, and help operators gain process insights. In this paper, we develop a system architecture for an IoT-enabled manufacturing system and demonstrate it on a bench-top milling machine. We explore on how we can build such a laboratory-scale system with commonly available, low-co...
Article
Full-text available
Connected vehicle technologies and applications must coevolve. Existing applications are often suboptimally implemented, stemming from a dearth of design approaches considering resource use, sensor selection, and communication method. Such design tools are necessary to optimize connected vehicle implementations, as applications may have varied impa...
Article
Full-text available
Fused deposition modeling's (FDM) throughput is limited by process physics as well as practical considerations favoring single-head polymer extrusion. To expedite the thermoplastic additive manufacturing process, we propose a parallelized material deposition process called local viscosity control (LVC) additive manufacturing. LVC prints an entire l...
Conference Paper
Full-text available
We address the problem of detecting whether an engine is misfiring by using machine learning techniques on transformed audio data collected from a smartphone. We recorded audio samples in an uncontrolled environment and extracted Fourier, Wavelet and Mel-frequency Cepstrum features from normal and abnormal engines. We then implemented Fisher Score...
Article
Full-text available
We address the problem of detecting whether an engine is misfiring by using machine learning techniques on transformed audio data collected from a smartphone. We recorded audio samples in an uncontrolled environment and extracted Fourier, Wavelet and Mel-frequency Cepstrum features from normal and abnormal engines. We then implemented Fisher Score...
Thesis
Full-text available
Intelligent and Connected Vehicles reduce cost, improve safety, and enhance comfort relative to isolated vehicles. This ability for cars to sense, infer, and act facilitates data-driven improvements in occupant experience and vehicle design. This thesis explores informed individual vehicle improvements and proposes a secure and efficient architectu...