I am creating a disease specific knowledge questionnaire, but my adviser is pushing for a community sample. I am new to test creation but from my understanding I need either a patient sample or expert sample (e.g. physicians, nurses, NPs...). Without either said samples I don't believe I can actually validate the measure. I will be proposing to conduct item analysis type statistics (item discrimination, item difficulty) but with a community sample I might get a very general low score on knowledge. Therefore, I'm trying to determine if there are analyses or ways to gather initial validation data. Any ideas or places of reference I could seek out would be helpful.
Thank you!