• Home
  • Marc Eliot Davis
Marc Eliot Davis

Marc Eliot Davis
MarcDavis.Me

PhD

About

72
Publications
7,238
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
3,081
Citations

Publications

Publications (72)
Patent
Full-text available
A system and method for Context Enhanced Mapping. A request is received from a user over a network for a map comprising an identification of a physical location, and at least one criteria. The physical location is mapped. Spatial, temporal, topical, and social data available to the network relating to the physical location and criteria is retrieved...
Patent
Full-text available
The disclosure describes systems and methods for modeling relationships between entities on a network using data collected from a plurality of communication channels including social data, spatial data, temporal data and logical data within a W4 Network. The W4 Network personalizes and automates sorting, filtering and processing of W4COMN communica...
Patent
Full-text available
Disclosed herein are example embodiments for behavioral fingerprinting via derived personal relation. For certain example embodiments, at least one indication of personal relation for at least one authorized user may be derived via at least one user-device interaction, and the at least one indication of personal relation may be incorporated into at...
Patent
Full-text available
Structures and protocols are presented for facilitating a search partly based on a movement status of a search-capable device or on a position of a person's limb or on an association with another search-capable device.
Patent
Full-text available
Methods and apparatus are described for detecting social relationships across multiple networks and/or communication channels. These social relationships may then be utilized in a wide variety of ways to support and enhance a broad range of user services.
Patent
Full-text available
A system and method for context based query augmentation. A question is received over a network from a questioning user comprising an identification of a user and at least one question criteria. A first query is formulated so as to search for user profile data, social network data, spatial data, temporal data and topical data in order to identify u...
Patent
Full-text available
A system and method for distributing media related to a location. The physical location of a media presentation device is received over a network. The physical location of a plurality of end users are identified, via the network, wherein each of plurality of users is associated with a user device capable of storing media files. At least one of the...
Patent
Full-text available
A media object, such as an image file, a video file, or an audio file, is analyzed to determine relationships between persons associated with the media object, which may include persons captured in the media object and/or a person that captured the media object. A representation of a first person captured in a media object is detected. The media ob...
Patent
Full-text available
A system and method for selecting and presenting media on a network to tune an environment to the tastes of the users within that environment, thus improving the experience of that location. A physical location of a media presentation device is received over a network. The physical location of a plurality of end users are identified via the network...
Patent
Full-text available
The disclosure describes systems and methods for optimizing the storage of data collected from a plurality of communication channels including social data, spatial data, temporal data and logical data. Based on user data collected from past interactions with the network, clusters of objects that include common information are combined into single o...
Patent
The disclosure describes systems and methods delivering communications based on contextual addresses. An address string containing two or more identifiers, which may not be unique identifiers, and at least one conditional operator are provided as the address for a message or communication. The system identifies contextual relationships between a pl...
Patent
Full-text available
The disclosure describes systems and methods for disambiguating a non-unique identifiers of real world entities (RWEs) detected by a computing network by dynamically identifying relationships between RWEs known to the network. The relationships are determined based on social, spatial, temporal and logical information known about the RWEs based on t...
Patent
Full-text available
The disclosure describes systems and methods for utilizing data collected and stored on multiple devices in order to improve the performance of the network via a markup language for addressing and delivering communications. The markup language invokes W4COMN operations through a free-form, natural language syntax which enables completely personaliz...
Patent
Full-text available
Methods and systems for processing multimedia content captured from a plurality of locations via one or more capturing devices include obtaining multimedia content from one or more capturing devices. The capturing devices identify a type of content being captured and/or location of capture. An interest type for multimedia content is obtained from a...
Patent
Full-text available
Systems, methods and apparatus for collecting data and presenting media to a user are provided. The systems generally includes a data gathering module associated with an electronic device. The data gathering module communicates gathered data to a management module, which manages at least one user profile based on the gathered data. The management m...
Article
Full-text available
To predict the uses of new technology, we present an approach grounded in science and technology studies (STS) that examines the social uses of current technology. As part of ongoing research on next-generation mobile imaging applications, we conducted an empirical study of the social uses of personal photography. We identify three: memory, creatin...
Conference Paper
Full-text available
Blogs, wikis, tagging, podcasts, and social networking websites such as MySpace, Facebook, Flickr and YouTube have radically changed user interactions on the World Wide Web from a static, one-way, consumption model to a dynamic, multi-way, participation model. Broad user power and flexibility have changed how people engage in and experience their i...
Article
This article addresses the problem of processing the annotations of preexisting video productions to enable reuse and repurposing of metadata. We introduce the concept of automatic content-based editing of preexisting semantic home video metadata. We propose a formal representation and implementation techniques for reusing and repurposing semantic...
Conference Paper
In recent years, tagging systems have become increasingly popular. These systems enable users to add keywords (i.e., "tags") to Internet resources (e.g., web pages, images, videos) without relying on a controlled vocabulary. Tagging systems have the potential to improve search, spam detection, reputation systems, and personal organization while int...
Conference Paper
The panel will explore the relevance of the emerging tagging systems (Flickr, Del.icio.us, RawSugar and more). Why do they seem to work? What kinds of incentives are required for users to participate? Will tagging survive and scale to mass adoption? What are the behavioral, economic, and social models that underlie each tagging system? What are the...
Article
Full-text available
This paper describes a new approach to the automatic detection of human faces and places depicted in photographs taken on cameraphones. Cameraphones offer a unique opportunity to pursue new approaches to media analysis and management: namely to combine the analysis of automatically gathered contextual metadata with media content analysis to fundame...
Article
Full-text available
This article addresses the problem of processing the annotations of preexisting video productions to enable reuse and repurposing of metadata. We introduce the concept of automatic content-based editing of preexisting semantic home video metadata. We propose a formal representation and implementation techniques for reusing and repurposing semantic...
Conference Paper
Full-text available
In recent years, tagging systems have become increasingly popular. These systems enable users to add keywords (i.e., "tags") to Internet resources (e.g., web pages, images, videos) without relying on a controlled vocabulary. Tagging systems have the potential to improve search, spam detection, reputation systems, and personal organization while int...
Conference Paper
We describe a framework for automatically selecting a sum- mary set of photos from a large collection of geo-referenced photographs. Such large collections are inherently di-cult to browse, and become excessively so as they grow in size, making summaries an important tool in rendering these col- lections accessible. Our summary algorithm is based o...
Article
ZoneTag is a rich mobile client that enables context-aware upload of photographs from cameraphones. In addition to automatically supplying location metadata for each photograph, ZoneTag supports media annotation via context-based tag suggestions. Sources for tag suggestions include past tags from the user, the user's social network, and the public,...
Article
Data regarding the physical location of GSM cell towers is important for many practical applications. Unfortunately, such data is not freely available in many countries. We present a system where users who tag and organize their camera-phone photos on Flickr implicitly contribute information about the physical location of cell towers. The system ha...
Article
We describe a framework for automatically selecting a summary set of photographs from a large collection of geo-referenced photos. The summary algorithm is based on spatial patterns in photo sets, but can be expanded to support social, temporal, as well as textual-topical factors of the photo set. The summary set can be biased by the user, the cont...
Conference Paper
In this paper we present a user-centered design process for Active Capture systems. These systems bring together techniques from human-human direction practice, multimedia signal processing, and human-computer interaction to form computational systems that automatically analyze and direct human action. The interdependence between the design of mult...
Conference Paper
Developments in networked digital imaging promise to substantially affect the near-universal experience of personal photography. Designing technology for image capture and sharing requires an understanding of how people use photos as well as how they adapt emerging technology to their photographic practices, and vice versa. In this paper, we report...
Conference Paper
Full-text available
As cameraphones become the dominant platform for consumer multimedia capture worldwide, multimedia researchers are faced both with the challenge of how to help users manage the billions of photographs they are collectively producing and the opportunity to leverage cameraphones' ability to automatically capture temporal, spatial, and social contextu...
Conference Paper
Though cameraphones are rapidly becoming the dominant platform for consumer digital photography, users still face difficulties in transferring, managing, and sharing photos captured with cameraphones. The Mobile Media Metadata 2 (MMM2) system removes the difficulty in transferring photos from the device by providing an automatic upload capability a...
Conference Paper
The number of digital photographs is growing beyond the abilities of individuals to easily manage and understand their own photo collections. Photo LOI (Level of Interest) is a technique that filters, aggregates, and visualizes photographs taken by multiple users who shared temporal, spatial, and/or social context at the point of photo capture. Pho...
Conference Paper
Full-text available
Advanced systems for finding, using, sharing, and remixing video require high-level representations of video content. A number of researchers have taken top-down, analytic approaches to the specification of representation structures for video. The resulting schemes, while showing the potential of high-level representations for aiding the retrieval...
Conference Paper
Full-text available
In this paper, we focus on the use of context-aware, collaborative filtering, machine-learning techniques that leverage automatically sensed and inferred contextual metadata together with computer vision analysis of image content to make accurate predictions about the human subjects depicted in cameraphone photos. We apply Sparse-Factor Analysis (S...
Conference Paper
The number of people using cameraphones is growing by tens of millions every month. Yet the majority of cameraphone users have difficulty transferring photos off their phone and sharing them with others. PhotoRouter is a software application for cameraphones that makes the photo sharing process destination-centric by allowing users to focus on who...
Article
Full-text available
Bluetooth has become a widely used source of co-presence information to determine a user's social context. However using Bluetooth in this way has several technological limi-tations including sensing time and effective range. This paper describes the technique of "Bluetooth pooling" which aggregates Bluetooth metadata collected from multiple users...
Article
We present a design case study for the SIMS Faces application. The SIMS Faces application is an Active Capture [1] application that works with the user to take her picture and record her saying her name for inclusion on the department web page. Active Capture applications are systems that capture and direct human action by working with the user, di...
Conference Paper
The domains of folk computing applications touch on areas of interest to people around the world but are of pressing need to those in the developing world who often lack access to basic services and rights: especially health care, education, nutrition, and protection of human rights. In this paper, we describe how a new paradigm for media capture,...
Conference Paper
Camera phones offer a new platform for digital imaging that integrates capture, programmable processing, networking, and rich user interaction capabilities. This platform can support software that leverages the spatio-temporal context and social community of image capture and (re)use to infer media content. Our mobile media metadata prototype (MMM)...
Article
In this paper, we report our experiences with the use of SemanticWeb technology for annotating digital video material.Web technology is used to transform a large, existing video ontology embedded in an annotation tool into a commonly accessible format. The recombination of existing video material is then used as an example application, in which the...
Conference Paper
The amount of personal digital media is increasing, and managing it has become a pressing problem. Effective management of media content is not possible without content-related metadata. In this paper we describe a content metadata creation process for images taken with a mobile phone. The design goals were to automate the creation of image content...
Conference Paper
Full-text available
As human-computer interaction becomes more closely modeled on human-human interaction, new techniques and strategies for human-computer interaction are required. In response to the inevitable shortcomings of recognition technologies, researchers have studied mediation: interaction techniques by which users can resolve system ambiguity and error. In...
Conference Paper
In this paper we describe a system that allows users to annotate digital photos at the time of capture. The system uses camera phones with a lightweight client application and a server to store the images and metadata and assists the user in annotation on the camera phone by providing guesses about the location and content of the photos. By conduct...
Conference Paper
Full-text available
The recent popularity of mobile camera phones allows for new opportunities to gather important metadata at the point of capture. This paper describes a method for generating metadata for photos using spatial, temporal, and social context. We describe a system we implemented for inferring location information for pictures taken with camera phones an...
Conference Paper
In the 2003, more camera phones were sold worldwide than digital cameras. With this new platform, we can leverage regularities in the spatio-temporal context and social community of media capture and use to infer media content. We created and deployed a "Mobile Media Metadata" (MMM) prototype on Nokia 3650 camera phones with 55 users that uses "con...
Article
As multimedia researchers analyze and design "experiential systems' there is a pressing need to place that work on a solid theoretical foundation. Without careful analysis of the objects and methods, terminology, and conceptual frameworks of experiential systems design, misconceptions about what experiences are and how they can be computationally a...
Conference Paper
While the devices for media capture have advanced from mechanical to computational since the invention of photography and motion pictures in the 19th century, their underlying user interaction paradigms have remained largely unchanged. Current interaction techniques for media capture do not leverage computation to solve key problems: the skill requ...
Article
This article outlines a paradigm shift in media production: the advent of computational media production that will automate the capture, editing, and reuse of video content. By integrating metadata creation and (re)use throughout the media production process, we enable the mass customization of video.
Conference Paper
Current consumer media production is laborious, tedious, and produces unsatisfying results. To address this problem, Active Capture leverages media production knowledge, computer vision and audition algorithms, and user interaction techniques to automate direction and cinematography and thus enables the automatic production of annotated, high quali...
Article
The term "narrative intelligence" originated when two students at the MIT Media Lab, from disparate backgrounds, formed an underground reading group to try and develop a common discourse. This group lasted many years and drew in an eclectic mix of students, faculty, and guests who were interested in pursuing interdisciplinary work at the intersecti...
Conference Paper
The Active Capture demonstration is part of a new computational media production paradigm that transforms media production from a manual mechanical process into an automated computational one that can produce mass customized and personalized media integrating video of non-actors. Active Capture leverages media production knowledge, computer vision...
Conference Paper
Current consumer media production is laborious, tedious, and produces unsatisfying results. To address this problem, Active Capture leverages media production knowledge, computer vision and audition algorithms, and user interaction techniques to automate direction and cinematography and thus enables the automatic production of annotated, high quali...
Article
The dangers of current and proposed legislation to our freedom to research, develop, and publish about digital media technologies requires a fundamental shift in our research focus. We need to invent technologies that aren't designed to protect copyright in a way that makes the exercise of fair use rights impossible-for private, noncommercial purpo...
Article
Full-text available
In order to enable the search and retrieval of video from large archives, we need a representation language for video content. Although some aspects of video can be automatically parsed, a sufficient representation requires that video be annotated. We discuss the design of a video representation language with special attention to the issue of creat...
Article
INTRODUCTION Programs are hard to build, and even harder to understand after they are built. We lack intuitive interfaces for visualizing and manipulating many parts of programs and the ways in which these parts interact. Constraint systems have addressed these problems. We generalize some of the notions inherent in constraint systems to agent-base...
Conference Paper
Full-text available
Describes a system, IDIC, which can generate a video sequence according to a story plan by selecting appropriate segments from an archive of annotated video. IDIC uses a simple planner to generate its stories. By critically examining the strengths and weaknesses of the representation and algorithm employed in the planner, the authors are able to de...
Conference Paper
Full-text available
In artificial intelligence, knowledge representation is the study of how the beliefs, intentions, and value judgments of an intelligent agent can be expressed in a transparent, symbolic notation suitable for automated reasoning. From a purely computational point of view, the major objectives to be achieved are breadth of scope, expressivity, precis...
Article
In an on-demand video server environment, clients make requests for movies to a centralized video server. Due to the stringent response time requirements, continuous delivery of a video stream to the client has to be guaranteed by reserving sufficient ...
Article
Thesis (Ph. D.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1995. Includes bibliographical references (p. 325-344). by Marc Eliot Davis. Ph.D.
Conference Paper
In order to enable the search and retrieval of video from large archives, we need a representation of video content. Although some aspects of video can be automatically parsed, a detailed representation requires that video be annotated. We discuss the design criteria for a video annotation language with special attention to the issue of creating a...
Article
Full-text available
The recent popularity of mobile camera phones allows for new opportunities to gather important metadata at the point of capture. This paper describes and demonstrates a method for generating metadata for images using spatial, temporal, and social context. We describe a system we implemented for inferring location information for pictures taken with...
Article
In this paper, we report our experiences with the use of Semantic Web technology for annotating digital video material. Web technology is used to trans- form a large, existing video ontology embedded in an annotation tool into a com- monly accessible format. The recombination of existing video material is then used as an example application, in whi...
Article
Full-text available
An important problem for technology design is predicting users and uses for emerging technologies—doing user- centered design for users and uses that don't yet exist. The primary contribution of this paper is in presenting a method for anticipating future uses of new technology by looking at users' higher-order motives or activities for current and...
Article
Full-text available
In recent years, tagging systems have become increasingly popular. These systems enable users to add keywords (i.e., “tags”) to Internet resources (e.g., web pages, images, videos) without relying on a controlled vocabulary. Tagging systems have the potential to improve search, spam detection, reputation systems, and personal organization while int...

Network

Cited By