Hassan Alrehamy

• PhD
• PhD at University of Babylon

I am running multiple evaluation tests on my new work regarding unsupervised AKE, Can you please list any social media or news datasets that are useful for evaluating AKE systems?

I need the dataset to be annotated with keyphrases by experts, and each annotation is based on controlled vocabulary.

I already have multiple scientific corpora like SemVal-2010, PubMed, and Inspec, but looking for datasets in other domains as my AKE system is domain-agnostic.

Thank you in advance.

Can you please list any clustering algorithms that don't require specifying the number of desired clusters in advance (e.g. Affinity Propagation)

For evaluation purpose, I need to evaluate my work using a dataset that contains changelogs describing the changes in schema during API upgrading.

It will help much if the changelogs swept from multiple well known APIs.

I have implemented Spectral Clustering in C# after long hours of struggling with the math behind its decomposition.

Now that I finished compiling and testing my code, I need to verify that my coding is correct, beyond 10 data points, verifying the goodness of my implementation using pen and paper is difficult, hence Can anyone please guide me where I can find an executable program / tool / toolbox that I can use to generate Top K eigen  vectors for large number of input data points ?

I googled for so many times but couldn't find such resource.

Thank you in advance.

The question's title is straightforward ... can you recommend any decent tool for annotating named entities in a collection of domain-specific textual materials, for instance, medical research papers.  I need to have a large training dataset in order to train my Maximum Entropy Sequence Model. However all the tools I checked online are either inaccurate or very difficult to use.

P.S/ the final output classifiers are domain specific, hence, the medical field is only an example, any recommendations of tools in different domain are most appreciated.

Thank you.

Which NLP library among the following ones below is the most mature and should be used in a scaled project of text processing.

In my project I am designing a full infrastructure of unstructured text processing, and there are scenarios where none of the available libraries can be leveraged, therefore I am implementing my own solution, however, I want to make evaluation against the current state of the art NLP libraries. and I want to pick up the most mature ones.

Thank you in advance.

Hassan.