Gensim

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
Gensim
Gensim logo.png
Original author(s)Radim Řehůřek
Developer(s)RaRe Technologies
Initial release2009
Stable release
3.6.0 / 20 September 2018; 4 months ago (2018-09-20)
Repositorygithub.com/RaRe-Technologies/gensim
Written inPython
Operating systemLinux, Windows, macOS
TypeInformation retrieval
LicenseLGPL
Websiteradimrehurek.com/gensim/

Gensim is a robust open-source vector space modeling and topic modeling toolkit implemented in Python. It uses NumPy, SciPy and optionally Cython for performance. Gensim is specifically designed to handle large text collections, using data streaming and efficient incremental algorithms, which differentiates it from most other scientific software packages that only target batch and in-memory processing.

Main features[edit]

Gensim includes implementations of tf-idf, random projections, word2vec and document2vec algorithms,[1] hierarchical Dirichlet processes (HDP), latent semantic analysis (LSA, LSI, SVD) and latent Dirichlet allocation (LDA), including distributed parallel versions.[2]

Some of the online algorithms in Gensim were also published in the 2011 PhD dissertation Scalability of Semantic Analysis in Natural Language Processing of Radim Řehůřek, the creator of Gensim.[3]

Uses of Gensim[edit]

Gensim has been used and cited in over 800 commercial and academic applications, in a diverse array of disciplines from medicine to insurance claim analysis to patent search[4][5] The software has been covered in several new articles, podcasts and interviews since 2009.[6][7][8]

Free and commercial support[edit]

The open source code is developed and hosted on GitHub[9] and a public support forum is maintained on Google Groups[10] and Gitter.[11]

Gensim is commercially supported by the company rare-technologies.com, who also provide student mentorships and academic thesis projects for Gensim via their Student Incubator programme.[12]

References[edit]

  1. ^ Deep learning with word2vec and gensim
  2. ^ Radim Řehůřek and Petr Sojka (2010). Software framework for topic modelling with large corpora. Proc. LREC Workshop on New Challenges for NLP Frameworks
  3. ^ Řehůřek, Radim (2011). "Scalability of Semantic Analysis in Natural Language Processing" (PDF). Retrieved 27 January 2015. my open-source gensim software package that accompanies this thesis
  4. ^ Gensim academic citations
  5. ^ Commercial adopters of Gensim
  6. ^ Podcast.__init__ episode #71 on Gensim
  7. ^ Interview with Radim Řehůřek, creator of Gensim
  8. ^ http://decisionstats.com/2015/12/07/decisionstats-interview-radim-rehurek-gensim-python/
  9. ^ Gensim source code on Github
  10. ^ Gensim mailing list on Google Groups
  11. ^ Gensim chat room on Gitter
  12. ^ Gensim open source Incubator

External links[edit]