Bryan A Liang’s research while affiliated with University of California System and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (225)


Assessing Characteristics and Compliance of Online Delta-8 Tetrahydrocannabinol Product Sellers
  • Article

May 2023

·

14 Reads

·

6 Citations

Cannabis and Cannabinoid Research

·

Tiana J McMann

·

·

[...]

·

Introduction: The debate over the legal status of many cannabis- and hemp-derived products, including delta-8 tetrahydrocannabinol (THC), is in question. Although low concentrations of delta-8 THC are legal at the Federal level, many states have implemented their own regulations to both allow and restrict its use and sale. Of concern, sellers with unknown legal credentials have appeared online and are actively selling this product. Materials and Methods: We characterized the marketing, sale, and compliance of online delta-8 THC sellers using (1) data collected from the Twitter Application Programming Interface with delta-8 THC-related keywords; (2) unsupervised topic modeling using the Biterm Topic Model to identify clusters of tweets involved in marketing and selling; (3) inductive coding to identify marketing and selling characteristics; and (4) web forensics and simulated shopping to determine compliance with state restrictions for delta-8 THC sales. Results: In total, 110 unique hyperlinks associated with 7085 tweets that included marketing and selling activity for delta-8 THC were collected. From these links, we conducted simulated purchasing in January 2021 to identify compliant and noncompliant websites. Among the vendors, age verification was not found in over half of websites (59, 53.63%); 60 (54.55%) did not report a physical address; and 74 (65.45%) sold delta-8 products direct-to-consumer. Sixty-seven (90.54%) of detected vendors shipped delta-8 products to addresses in states that prohibit sales. Forty-three (64.18%) of Internet Protocol addresses were located within the United States; all others were international. Conclusion: Our analysis suggests that online storefronts are illegally selling and shipping cannabinoid derivatives to U.S. consumers. Further research is needed to understand downstream health and regulatory impacts from this unregulated access.




China Charity Law-related literature
Information about document sources
China charity federation revenue from donations and total expenditures (data from China Foundation Center)
An Analysis of China Health Charity Credibility Before and After the 2016 Charity Law of the People’s Republic of China
  • Article
  • Full-text available

June 2021

·

270 Reads

·

3 Citations

Asian Journal of Criminology

Due to corruption and limited oversight, philanthropy in China has come under increasing scrutiny by both the Chinese government and public. In particular, corruption has impacted charities, resulting in operational funding declines that have also impacted legitimate charities serving the vulnerable. Hence, an increase in the number of Chinese charities without adequate transparency and needed good governance threatens the health of these organizations and their service groups. In response, the Chinese government enacted the 2016 Charity Law, implemented on September 1, 2016. Yet the impact of this law, if any, is unknown. We therefore conducted a literature review of the academic and gray literature to assess characteristics of the law, its strengths and limitations, and to explore anti-corruption case studies. In addition, we reviewed publicly available secondary data on the transparency status—complete financial information and responsible staff—of Chinese charity organizations and a group of health-related specific charities before and after the Law’s enactment. This included the transparency scores of the top 100 charities and top 30 health-related charities in China. The academic literature we reviewed focused on general governmental corruption and little on charity-related corruption. However, the gray literature reflected a poor view of charities in China due to publicized claims of fund and abuse. Based on our secondary data analysis, we found charity organizations’ transparency shows some variation but as a total continues to score low overall across the top net asset holding charities. Importantly, based on a regression analysis, the transparency scores of Chinese charities did not experience a significant change despite the Charity Law’s enactment. In response, strengthening the Charity Law by enhancing enforcement of financial regulations and implementing systemic good governance measures is needed. Further, efficiency initiatives such as philanthropy de-administration, e-government, and outsourcing monitoring of Chinese charities to external agencies would promote trustworthiness and credibility of Chinese charity organizations now and in the future.

Download

Figure 1. Summary of study methodology. The first phase (yellow) is collection of data from the public streaming Twitter application programming interface and using a web scraper on Instagram to collect social media posts filtered for COVID-19-related keywords; the second phase (blue) used BTM to isolate topic clusters related to COVID-19 product sales to develop an initial training set for classification of posts using a deep learning algorithm (green). Data output by the deep learning classifier was then manually coded for true signals and selling characteristics (orange). Finally, the visualization of labeled data on a customized dashboard to enable public health intelligence and reporting to public health agencies was conducted (grey). BTM: biterm topic model; COVID-19: coronavirus disease; LSTM: long short-term memory.
Figure 2. Timeline for volume and topics of signal posts related to suspect coronavirus disease products on Twitter and Instagram. PPE: personal protective equipment.
Figure 3. Twitter and Instagram posts related to suspected COVID-19 treatments and remedies. COVID-19: coronavirus disease; WHO: World Health Organization.
Figure 4. Twitter and Instagram posts related to suspected COVID-19 testing kits. COVID-19: coronavirus disease; SARS-CoV-2: severe acute respiratory syndrome coronavirus 2.
Figure 5. Twitter and Instagram posts related to suspected COVID-19 pharmaceutical drugs. COVID-19: coronavirus disease.
Big Data, Natural Language Processing, and Deep Learning to Detect and Characterize Illicit COVID-19 Product Sales: An Infoveillance Study on Twitter and Instagram (Preprint)

May 2020

·

146 Reads

·

101 Citations

JMIR Public Health and Surveillance

Background: The COVID-19 pandemic is perhaps the greatest global health challenge of the last century. Accompanying this pandemic is a parallel "infodemic", including the online marketing and sale of unapproved, illegal and counterfeit COVID-19 health products, including testing kits, treatments, and other questionable "cures". Enabling proliferation of this content is growing ubiquity of Internet-based technologies, including popular social media platforms that now have billions of global users. Objective: To collect, analyze, identify and enable reporting of suspected fake, counterfeit, and unapproved COVID-19-related healthcare products from Twitter and Instagram. Methods: The study was conducted in two phases beginning with collection of COVID-19-related Twitter and Instagram posts using a combination of web scraping on Instagram and filtering the public streaming Twitter API for keywords associated with suspect marketing and sale of COVID-19 products. The second phase involved data analysis using natural language processing and deep learning to identify potential sellers that were then manually annotated for characteristics of interest. We also visualized illegal selling posts on a customized data dashboard to enable public health intelligence. Results: We collected a total of 6,029,323 tweets and 204,597 Instagram posts filtered for terms associated with suspect marketing and sale of COVID-19 health products from March - April for Twitter and February - May for Instagram. After applying our NLP and deep learning approaches, we identified 1,271 tweets and 596 Instagram posts associated with questionable sales of COVID-19-related products. Generally, product introduction came in two waves, with the first consisting of questionable immunity-boosting treatments and a second involving suspect testing kits. We also detected a low volume of pharmaceuticals that have not been approved for COVID-19 treatment. Other major themes detected included products offered in different languages, various claims of product credibility, completely unsubstantiated products, unapproved testing modalities, and different payment and seller contact methods. Conclusions: Results from this study provide initial insight into one front of the "infodemic" fight against COVID-19 by characterizing what types of health products, selling claims and types of sellers were active on two popular social media platforms at earlier stages of the pandemic. This cybercrime challenge is likely to continue as the pandemic progresses and more people seek access to COVID-19 testing and treatment. This data intelligence can help public health agencies, regulatory authorities, legitimate manufacturers, and technology platforms better remove and prevent this content from harming the public. Clinicaltrial: Not applicable.


Big Data, Natural Language Processing, and Deep Learning to Detect and Characterize Illicit COVID-19 Product Sales: An Infoveillance Study on Twitter and Instagram (Preprint)

May 2020

·

44 Reads

·

5 Citations

BACKGROUND The COVID-19 pandemic is perhaps the greatest global health challenge of the last century. Accompanying this pandemic is a parallel “infodemic”, including the online marketing and sale of unapproved, illegal and counterfeit COVID-19 health products, including testing kits, treatments, and other questionable “cures”. Enabling proliferation of this content is growing ubiquity of Internet-based technologies, including popular social media platforms that now have billions of global users. OBJECTIVE To collect, analyze, identify and enable reporting of suspected fake, counterfeit, and unapproved COVID-19-related healthcare products from Twitter and Instagram. METHODS The study was conducted in two phases beginning with collection of COVID-19-related Twitter and Instagram posts using a combination of web scraping on Instagram and filtering the public streaming Twitter API for keywords associated with suspect marketing and sale of COVID-19 products. The second phase involved data analysis using natural language processing and deep learning to identify potential sellers that were then manually annotated for characteristics of interest. We also visualized illegal selling posts on a customized data dashboard to enable public health intelligence. RESULTS We collected a total of 6,029,323 tweets and 204,597 Instagram posts filtered for terms associated with suspect marketing and sale of COVID-19 health products from March – April for Twitter and February – May for Instagram. After applying our NLP and deep learning approaches, we identified 1,271 tweets and 596 Instagram posts associated with questionable sales of COVID-19-related products. Generally, product introduction came in three waves, with the first consisting of questionable immunity-boosting treatments, a second involving suspect testing kits, and a third of pharmaceuticals that have not been approved for COVID-19 treatment, with these waves following news coverage about product developments. Other major themes detected included accounts with descriptive COVID-19 accounts, products offered in different languages, various claims of product credibility, unsubstantiated products, unapproved testing modalities, and different payment and seller contact methods. CONCLUSIONS Results from this study provide initial insight into one front of the “infodemic” fight against COVID-19 by characterizing what types of health products, selling claims and types of sellers are active on two popular social media platforms. The challenge of combating this form of cybercrime is likely to continue as the pandemic progresses and more people seek access to COVID-19 information and treatment. Visualization of detected sellers and identification of their social media communication strategies can provide needed intelligence to public health agencies, regulatory authorities, legitimate manufacturers, and technology platforms to better remove and prevent this content from harming the public.


Figure 1. Volume of total signal Twitter posts filtered for the coronavirus disease symptom terms plotted over the study period (March 3-20, 2020).
Figure 2. Volume of confirmed symptom tweets plotted over the study period (March 3-20, 2020).
Figure 3. Distribution of tweets originating from the United States as point coordinates overlaid on a choropleth gradient denoting population-normalized coronavirus disease cases on March 20, 2020 (final day of data collection).
Machine Learning to Detect Self-Reporting of Symptoms, Testing Access, and Recovery Associated With COVID-19 on Twitter: Retrospective Big Data Infoveillance Study

April 2020

·

352 Reads

·

147 Citations

JMIR Public Health and Surveillance

Background The coronavirus disease (COVID-19) pandemic is a global health emergency with over 6 million cases worldwide as of the beginning of June 2020. The pandemic is historic in scope and precedent given its emergence in an increasingly digital era. Importantly, there have been concerns about the accuracy of COVID-19 case counts due to issues such as lack of access to testing and difficulty in measuring recoveries. Objective The aims of this study were to detect and characterize user-generated conversations that could be associated with COVID-19-related symptoms, experiences with access to testing, and mentions of disease recovery using an unsupervised machine learning approach. Methods Tweets were collected from the Twitter public streaming application programming interface from March 3-20, 2020, filtered for general COVID-19-related keywords and then further filtered for terms that could be related to COVID-19 symptoms as self-reported by users. Tweets were analyzed using an unsupervised machine learning approach called the biterm topic model (BTM), where groups of tweets containing the same word-related themes were separated into topic clusters that included conversations about symptoms, testing, and recovery. Tweets in these clusters were then extracted and manually annotated for content analysis and assessed for their statistical and geographic characteristics. ResultsA total of 4,492,954 tweets were collected that contained terms that could be related to COVID-19 symptoms. After using BTM to identify relevant topic clusters and removing duplicate tweets, we identified a total of 3465 (


Machine Learning to Detect Self-Reporting of COVID-19 Symptoms, Testing Access and Recovery on Twitter: A Retrospective Big-Data Infoveillance Study (Preprint)

April 2020

·

63 Reads

·

1 Citation

BACKGROUND The coronavirus (COVID-19) pandemic is a globally, rapidly spreading event with close to 2.5 million cases as of mid-April, representing an outbreak of historical scope and one with an accelerating trajectory. However, there are ongoing concerns about the accuracy of COVID-19 case counts due to issues such as lack of access to testing and difficulty in measuring recoveries. OBJECTIVE The aims of this study were to detect and characterize user-generated conversations of COVID-19-related symptoms, experiences with access to testing, and mentions of recovery using an unsupervised machine learning approach. METHODS Tweets were collected from the Twitter public API from March 3-20 filtered for general COVID-19-related keywords and then further filtered for terms related to COVID-19 symptoms. After data cleaning and processing data, tweets were analyzed using an unsupervised machine learning approach called the biterm topic model (BTM), where groups of tweets containing the same word-related themes were separated into topic clusters related to COVID-19 symptoms, testing, and recovery conversations. Tweets in these clusters were then extracted and manually annotated for content analysis and then analyzed for statistical and geographic characteristics. RESULTS A total of 4,492,954 tweets were collected that contained COVID-19-related symptom terms. After using BTM to identify relevant COVID-19 clusters and removing duplicate tweets, we identified a total of 3,465 (<1%) tweets that included user generated conversations about experiences perceived to be related to COVID-19. These tweets were grouped into five main categories including first and second-hand reports of COVID-19-related symptoms, symptom reporting concurrent with lack of access to testing, discussion of recovery, confirmation of negative COVID-19 diagnosis after receiving testing, and users recalling past symptoms and questioning whether they had been previously infected with COVID-19. Co-occurrence of themes was statistically significant for users reporting symptoms with lack of testing and with discussion of recovery. Sixty-three percent (n=1112) of tweets with geospatial coordinates were from the U.S. CONCLUSIONS In this study, we analyzed Twitter for the purposes of characterizing conversations regarding self-reporting of COVID-19-related symptoms, access to testing, and experiences with purported recovery for the purposes of digital contact tracing. It appears that many users reported COVID-19-related symptoms, but never got tested due to lack of access. However, it is unclear how many of these users were actual cases and in the absence of further testing, accurate case estimations may never be known. Future studies should continue to explore the utility of social media and other forms of electronic data to estimate COVID-19 disease severity.




Citations (74)


... Given there are minimal regulations around the sales of delta-8 THC in Texas, we did not account for retailers that may be selling these products without one of these licenses. Our study was also limited to retail stores, and online purchasing of delta-8 THC products may be another important avenue of availability, especially for youth given lack of age of verification systems (Egan et al., 2023;Nali et al., 2023). Additionally, there were 63 schools with Euclidean buffers that extended beyond the Fort Worth municipal boundaries, so there may have been retailers that fell within these school buffers that were not included in the sample; however, the overall land area of buffers that extended beyond municipal boundaries was small (7.62 square miles total). ...

Reference:

Retail Availability of Delta-8 THC Near Schools, Fort Worth, Retail Availability of Delta-8 THC Near Schools
Assessing Characteristics and Compliance of Online Delta-8 Tetrahydrocannabinol Product Sellers
  • Citing Article
  • May 2023

Cannabis and Cannabinoid Research

... In a world where information is generated on an unprecedented scale, such as images, videos, and transactions, deep neural networks-which are the basis of DL-can detect complex patterns and deliver very accurate results. This is vital in areas such as e-commerce, social networking, and especially in medicine [22,23]. ...

Big Data, Natural Language Processing, and Deep Learning to Detect and Characterize Illicit COVID-19 Product Sales: An Infoveillance Study on Twitter and Instagram (Preprint)

JMIR Public Health and Surveillance

... Another work of [87] demonstrates a high level of accuracy in distinguishing reliable and unreliable tweets, including COVID-19 content. A total of 4,492,954 tweets associated with COVID-19 symptoms were gathered. ...

Machine Learning to Detect Self-Reporting of Symptoms, Testing Access, and Recovery Associated With COVID-19 on Twitter: Retrospective Big Data Infoveillance Study

JMIR Public Health and Surveillance

... This presents opportunities and challenges for health care businesses that face ever-increasing demands to adopt and use digital technologies in both the provision of health care and marketing of goods and services. 1 From the marketing perspective, the need to reach potential patients and customers digitally is at an all-time high. Digital advertising spending in the United States alone is expected to increase 19% this year to a record $107 billion, and this year's advertising revenue from Facebook is expected to increase 17%. 2 While other social media sites are growing more rapidly, Facebook, with over 2.2 billion active monthly users worldwide and over 202 million in the United States, is still by far the biggest and most influential. ...

Health Advertising in the Digital Age: Future Trends and Challenges
  • Citing Chapter
  • February 2017

... Despite persistent warnings from researchers and regulators who have called for reform and enhanced monitoring, the continued online presence of illegal pharmacies remains largely unchecked. Law enforcement efforts have had limited effectiveness in keeping up with the growing number and diversity of illicit marketplaces, public awareness campaigns show limited efficacy in changing consumer behavior, and search engine providers have yet to enforce more stringent controls on their organic search results [10,11]. ...

Mapping of Health Communication and Education Strategies Addressing the Public Health Dangers of Illicit Online Pharmacies
  • Citing Article
  • February 2016

... Interculturality has many definitions and interpretations, depending on context and applicability to particular segments of society (Lincoln, Liang & Mackey: 2015). Newcomers -weather from other cities within and beyond national border of from rural areas-contribute to the increasing diversity and complexity of interactions in cities (UNESCO: 2016). ...

Interculturalidad and Chilean health: Stakeholder perceptions and the intercultural hospital delivery model

International Journal of Indigenous Health

... e-Pharmacy can, therefore, prove to be an important tool in the armamentarium of Indian health policy makers to improve universal health coverage [7]. On the other hand, the growth of rogue e-pharmacies is a significant concern worldwide, especially in low-and middle-income countries (LMICs), which often lack specific regulations for the online sale of medicines [8,9]. The proliferation of e-pharmacy in India so far has been largely beyond existing regulatory mechanisms with issues related to the quality of medicines and dispensing errors [10,11,12]. ...

Illicit Internet availability of drugs subject to recall and patient safety consequences
  • Citing Article
  • July 2015

International Journal of Clinical Pharmacy

... These strategies have become more vital than ever due to the growth of the Internet as the primary engine of economic growth worldwide (Al-Hawary and Obiadat, 2019). The pharmaceutical industry has experienced a remarkable rise in the significance of digital marketing (Mackey et al., 2015). It has opened up new avenues for connecting with patients, healthcare providers (HCPs), and other stakeholders, disseminating vital information and fostering trust and credibility. ...

The rise of digital direct-to-consumer advertising?: Comparison of direct-to-consumer advertising expenditure trends from publicly available data sources and global policy implications Utilization, expenditure, economics and financing systems

BMC Health Services Research