ArticlePDF Available

Solving the Mystery of Consistent Negative/Low Net Promoter Score (NPS) in Cross-Cultural Marketing Research

Authors:

Abstract

This paper has identified some theoretical reasons and empirical evidence for negative scores that occur in Japan and Korea or unstable NPS scores that can be experienced. A psychological analysis of NPS results sheds light on the validity of the negative NPS scores that are often found in Japan and Korea. Usually customer experience surveys utilize a “single stimulus” such as the “company” or the “company’s products / services.” However, in the case of the “recommendation to friend” question of the NPS system there are two stimuli namely the “company product/service” and the influence of “friends.” Hence, the survey outcomes from this question can be very different when compared with other single stimulus questions such as “overall satisfaction” or “repurchase.” Japanese and Korean people may have a positive attitude towards the company but they will provide low NPS scores because they are reflecting that they would not run the risk of ruining their relationships with their friends by making a recommendation. As a result, in the NPS system these people will be labeled as “detractors” when in fact they are “ambivalent customers.” Using several Japanese and Korean based marketing research industry examples and case studies, different strategies are proposed to address the issue of negative scores in the NPS system in Japan and Korea. The Customers Psyche appears to be the key determinant factors for both types of behavioural items (items with a single stimulus as well as items with two stimuli).
  󸁚
    
    
 













 
















  

         






http://dx.doi.org/10.15830/amj.2016.17.4.43
  

          


 



  



 



   




  



















































 




  







  





 









    







  










    

  

 


















     




























  
             



      




         

 

  
   










       
    




      


   



       
   





  
        





   





Q2. How likely is it that you would recommend “company” to a “friend or colleague”?
Q1. How satisfied were you with your Customer Support experience of “company”?
2 Stimuli
Responses Responses
+ve +ve-ve -ve
Company Friends
2 Stimuli
Responses Responses
+ve +ve-ve-ve -ve-ve
CompanyCompany FriendsFriends

  
  










 




      








  
         




  




  

 










    


          
 


   






 






  
  

  





 






               






Cultures
Public
Space
Private
Space
AA
BB
Cultures
Public
Space
Private
Space
AA
BB

  




   

   





 

        



          




      


   

      

 




  




        


  




 



   








  
  





  


 



  




   
 
  
     

   












  


 




    


   



    

    



      






    
       



      








   


  



 

 


  




  



  









  

  

 






     
           









  





  





       




      
   
 




  

      

      



 







   


  





 



                
 









      



        




        



󻂕
        

󻂕
         


󻂕
         

  

    




    

      

 



  




  


   













          



       








                 





      











 




 





   




        

   







       



   






  
                












  


   








     

      


    







         

  
   




   

    














    



    


      
     



        

   



 


     
 





                  





 



     
   
  
   


     

     



 
    







   
  
      






   



   




  


   



  
   





     
    
 



 

 


         
   
    







      






 

  
    

 

  
   


 



   


 


    
 



     
  


















 




    












 




     




 
   
 










 


     
   




      

    
 


       
   

  


... and used a slightly altered version of NPS: "Unlike the original, ten position scale range from 1 to 10 was used to be consistent with other questions used in the survey and to eliminate the middle answer." [9, p. 147] • The team from Seth et al. [69] wanted to find out why NPS scores typically were lower in Asian countries when compared to other areas in the world, and pinpointed cultural differences as the major factor (the conceptual difference between evaluating the company's performance and recommending the company to a friend) [69]. Our team agreed that it was critical to consider cultural differences (as discussed in Section 2.4), and that we would need to carefully consider the difference between "company/product" and the "recommendation" aspect of the NPS for the Deaf community. ...
... and used a slightly altered version of NPS: "Unlike the original, ten position scale range from 1 to 10 was used to be consistent with other questions used in the survey and to eliminate the middle answer." [9, p. 147] • The team from Seth et al. [69] wanted to find out why NPS scores typically were lower in Asian countries when compared to other areas in the world, and pinpointed cultural differences as the major factor (the conceptual difference between evaluating the company's performance and recommending the company to a friend) [69]. Our team agreed that it was critical to consider cultural differences (as discussed in Section 2.4), and that we would need to carefully consider the difference between "company/product" and the "recommendation" aspect of the NPS for the Deaf community. ...
Article
To promote greater inclusion of people who are Deaf and Hard of Hearing (DHH) in studies conducted by Human-Computer Interaction (HCI) researchers or professionals, we have undertaken a project to formally translate several standardized usability questionnaires from English to ASL. Many deaf adults in the U.S. have lower levels of English reading literacy, but there are currently no standardized usability questionnaires available in American Sign Language (ASL) for these users. A critical concern in conducting such a translation is to ensure that the meaning of the original question items has been preserved during translation, as well as other key psychometric properties of the instrument, including internal reliability, criterion validity, and construct validity. After identifying best-practices for such a translation and evaluation project, a bilingual team of domain experts (including native ASL signers who are members of the Deaf community) translated the System Usability Scale (SUS) and Net Promoter Score (NPS) instruments into ASL and then conducted back-translation evaluations to assess the faithfulness of the translation. The new ASL instruments were employed in usability tests with DHH participants, to assemble a dataset of response scores, in support of the psychometric validation. We are disseminating these translated instruments, as well as collected response values from DHH participants, to encourage greater participation in HCI studies among DHH users.
... This index is calculated by subtracting the percentage of detractors (respondents 0-6) from the percentage of promoters (respondents 9-10) based on an 11-point scale (0-10) of recommendation intention (Reichheld 2003). Japanese individuals who dislike both ends have an extremely low percentage of promoters, negative NPS scores, and poor function (Seth et al. 2016). ...
Chapter
In marketing surveys, the question order bias and response order bias are known from the viewpoint of order, while the response scale bias and central tendency bias are known from the viewpoint of the Likert scale, and a large amount of literature exists to support this. However, there is no evidence of bias due to the ascending or descending order of the Likert scale. This study filled this gap. An online survey of loyalty at Japanese universities was collected from 338 individuals. The result showed that since respondents prefer the first option, the descending order with the highest score on the upper side obtained a higher score. When determining the loyalty indices on the Likert scale in measuring marketing effectiveness, the true effectiveness cannot be known unless the order of options is consistent. In addition, since less serious respondents prefer higher options, the ascending order should be adopted to improve the quality of answers with good scores. This makes it possible to improve the accuracy of identifying customers with high loyalty. Thus, ascending options in the loyalty index question eliminate spurious loyalty due to insincere answers. Research design that understands the mechanisms of bias and limits uncertainty is essential in both business and academic research. This study provides useful suggestions for effect measurement, which is indispensable in digital marketing.KeywordsLikert scaleQuestion order biasResponse order biasResponse scale biasCentral tendency bias
... A typical example is the intermediate response tendency, which avoids response scale endpoints and prefers responses close to the midpoint (Douven 2018). These cultural characteristics, which are prevalent among Asian cultures, for example (Harzing et al. 2012), and especially among the Japanese (Iwata et al. 1989(Iwata et al. , 1994 cause the NPS method to reflect a negative score (Seth et al. 2016). Likert scales cannot escape this bias (MacKinnon et al. 2021); accordingly, a universally applicable perspective is essential. ...
Article
Full-text available
As a loyalty index, the net promoter score (NPS) has attracted much attention. The simplicity of this index has been overwhelmingly well received by industry, and many organizations have adopted it. However, studies using NPS are less frequent and, often, they reach a negative conclusion about the effectiveness of the index. This outcome is mainly because NPS does not have a particularly good explanatory power for business performance, compared with satisfaction and other loyalty indices. Despite academic criticism, industry still relies on NPS because no other simple and robust index has been proposed. Therefore, this study proposes a new index, the next purchase intention brand (NPI), as an alternative loyalty index. Unlike existing indices, NPI identifies the one brand that the customer would most likely continue purchasing using a single answer. Only brands with high loyalty receive scores; the survey results are unaffected in markets targeting countries with intermediate response tendencies. For six consumer goods categories (beer, deodorant, green tea, instant noodles, nutrition drink, and shampoo) in Japan, the NPI index has a higher explanatory power for market share than general loyalty indices. The study recommends that corporate practitioners re-examine the items that demand extensive marketing research.
... Following the arguments put forward by Dolnicar and Grün (2007), Seth et al. (2006) argue that there are issues related to the use of NPS in cross-cultural research, and the results of their study suggest that cultural differences are likely to have an impact on the NPS scores. Therefore, when analysing the results of this study, which indicated that there are differences in customer satisfaction and the customers' willingness to recommend Company X to family or friends, the impact of culture on the NPS scores needs to be considered. ...
Article
Full-text available
Customer satisfaction is a primary focus for an increasing number of companies, as customers who are highly satisfied with a product or a service provide positive word-of-mouth to others. Therefore, many companies are tracking both customer satisfaction and dissatisfaction in order to ensure high levels of customer satisfaction, and thus, increase the number of customer referrals. As many companies today are operating in a cultural environment that affects their business on many different levels, it is highly important to acknowledge the cultural aspects in international business. Previous studies show that people from different cultures are likely to judge the same service differently based on differences in the perceived quality, and therefore, companies ought to take cultural differences into consideration when comparing customer feedback between different markets. This study examines the influence of culture on customer satisfaction and the customers’ willingness to recommend a company to others, by analysing customer feedback on the Swedish, Finnish, Norwegian and Danish markets, collected by Company X. The main objective of the study is to provide a deeper understanding of how cultural differences between Sweden, Finland, Norway and Denmark influence customer satisfaction, and thus, the potential customer referrals. This study applies both quantitative and qualitative analysis techniques and the empirical findings are analysed with the support of Hofstede’s framework of culture. The results of the quantitative analysis showed that there were differences in customer satisfaction and the customers’ willingness to recommend the company to others, between the markets. The Finnish customers were the most likely to recommend Company X to family or friends, whereas the customer on the Danish market were the most satisfied with the overall experience. On the Swedish, Norwegian and Danish markets, lack of responsiveness was the main reason for the dissatisfaction, whereas the main reason for dissatisfaction among the Finnish customers was Company X’s inability to provoke trust and confidence. Additionally, empathy in service was the main reason for satisfaction among the customers in Sweden, Norway, and Denmark, whereas the main reasons for satisfaction among the Finnish customers were responsiveness and reliability in service. Thus, the findings suggest that customers in the Finnish market judge the quality of a service differently than the customers on the Swedish, Norwegian and Danish markets
... However, NPSs in Japan are reported to be lower than those in other areas because Asian people tend to prefer intermediate scores (e.g. four to six in 10-Likert scale) which are regarded as 'Detractors' when calculating an NPS (Seth et al. 2016). In Japan, even for a service with top customer satisfaction in each industry, its NPS can often be below zero. ...
Article
Full-text available
Internet-delivered intervention may be an acceptable alternative for the more than 90% of problem gamblers who are reluctant to seek face-to-face support. Thus, we aimed to (1) develop a low-dropout unguided intervention named GAMBOT integrated with a messaging app; and (2) investigate its effect. The present study was a randomised, quadruple-blind, controlled trial. We set pre-to-post change in the Problem Gambling Severity Index (PGSI) as the primary outcome and pre-to-post change in the Gambling Symptom Assessment Scale (G-SAS) as a secondary outcome. Daily monitoring, personalised feedback, and private messages based on cognitive behavioural theory were offered to participants in the intervention group through a messaging app for 28 days (GAMBOT). Participants in the control group received biweekly messages only for assessments for 28 days (assessments only). A total of 197 problem gamblers were included in the primary analysis. We failed to demonstrate a significant between-group difference in the primary outcome (PGSI − 1.14, 95% CI − 2.75 to 0.47, p = 0.162) but in the secondary outcome (G-SAS − 3.14, 95% CI − 0.24 to − 6.04, p = 0.03). Only 6.7% of the participants dropped out during follow-up and 77% of the GAMBOT group participants (74/96) continued to participate in the intervention throughout the 28-day period. Integrating intervention into a chatbot feature on a frequently used messaging app shows promise in helping to overcome the high dropout rate of unguided internet-delivered interventions. More effective and sophisticated contents delivered by a chatbot should be sought to engage over 90% of problem gamblers who are reluctant to seek face-to-face support.
... The findings illustrate the variance both within and across nations. Consider the case of Japan, a nation whose citizens typically provide low NPS scores because they do not want to run the risk of ruining their relationships with their friends by making a recommendation (Seth et al. 2016). Indeed, this tendency is certainly the case among Inactives, Network Updaters, and Blogging Reporters. ...
Article
Given Millennials’ early digital life experiences, the adoption of social media tends to be greater among members of this generation compared to older ones. However, studies that report such age-based generalizations tend to neglect the phenomenon of intragenerational variability in social media use, providing an oversimplified picture of how people behave. Moreover, studies that compare social media use across nations are lacking, and are also needed to establish the generality of this phenomenon. This paper investigates intragenerational variability in social media sharing among Millennial travelers in six nations (Canada, France, India, Japan, Mexico, and USA) using Destination Canada’s Global Tourism Watch database. A latent class segmentation model is used to identify groups of travelers with different ways of using social media to share trip experiences. Results supported five unique classes of social media sharing, ranging from nonuse to highly integrated sharing across many platforms. Additionally, class membership is predicted by covariates (nationality, travel experience, and social media use and goals) and is predictive of destination advocacy (offering recommendations). The identification of different classes of social media sharing advances theory on intragenerational and cross-national variability, and informs the development of international strategies that target Millennial travelers based on their tendency to share and advocate.
... Last two properties are harder to fulfil, and even established indicators like for instance the Net Promoter Score metric, are not easily comparable across cultures (Seth et al., 2016). Taking into account mentioned properties of the metrics, two propositions are made in the next part of the paper, including considerations about data sources used for calculations. ...
Article
Full-text available
Multi-channel consumer behaviour has become an everyday reality. Increasing numbers of purchasing processes are carried out using more than one channel. However, there are no commonly used measures of multichannel consumer behaviour intensity. The article attempts to fill this gap-it proposes two primary indices for the intensity of multi-channel behaviours: in a specific purchasing process (MCA_IPI-in two variants) and for many purchasing processes (MCA_MPI). The last measure looks particularly promising as being a normalised to the 0-1 range index, and independent of the number of analysed channels as well as the separate stages of the purchasing process. Proposed measures have practical applications-they allow to segment the buyers regarding the intensity of multi-channel behaviours and to observe changes in the structure of channel use by buyers over the time.
Chapter
This study explores key determinants of airline recommendations by integrating ratings and text comments scraped from online source. Numerical review scores are used to characterize features on how passengers decide to recommend others. Text analysis technique provides information of service attributes that differentiate positive and negative comments. Using generated frequent words visualization of Word Cloud, the results suggested that positive recommenders are satisfied with human dimensions such as personality and friendly services, while negative comments suggested frequent complaints on poor operational dimensions such as on-time performance and seat comfort.
ResearchGate has not been able to resolve any references for this publication.