Skip to content

Releases: orai-nlp/MSM

v1.4.0

23 Aug 09:41
Compare
Choose a tag to compare

Feedreader crawled news are now stored as pdf, in a selected folder. If no folder is selected pdfs go to /tmp/

Jar compiled with java 1.8

Susbcription based feeds support

10 Aug 16:29
Compare
Choose a tag to compare

Support for susbcription based feeds is added. Final user is responsible of managing the subscriptions, valid credentials must be provided. subscription based feeds are processed using selenium.

1.3.8

27 Jul 10:56
bfc3606
Compare
Choose a tag to compare

Dependency updating and bug fixing. Added maven workflow

feed reader fixes

22 Nov 14:49
Compare
Choose a tag to compare

Mainly bug fixes. Most relevant change is the fix en FeedReader's http client for handling ssl certificates and addin a custom user agent.

v1.3.5

27 Jun 14:16
Compare
Choose a tag to compare

Added parameter '--twitterLangid' to twitter client, in order to use directly twitter API language parameter. MSM still performs language identification, but if this option is active tweets received from the stream will be previously filter by twitter. BEFORE using this option check that all the languages you are going to work with are identified by twitter.

Also twitter client standard output is fixed to return json like objects (not actual json object but java object strings). Still pending to print proper json.

Also: added some dependencies for youtube api to compile in pom.xml, but still untested, development ongoing under "youtube" branch.

Bug fixes and corrections

18 May 16:32
Compare
Choose a tag to compare

Use this over 1.3.3.

Mainly bug fixes. Also added a new option to twitter user info functionality,

Geocoding functionality

18 May 14:01
Compare
Choose a tag to compare

Added geocoding functionality. Geocoding may be done using one or several APIs.
IMPORTANT: In order to use those APIs you have to obtain the corresponding keys. in MSM, each API has an request url and a rate limit associated to their free plans. If you subscribe to a higher pricing plan you will have modify those values (or make several call to MSM. The rate limit is not shared between MSM instances at the moment). In any case the user is responsible for readings the conditions of each API and respecting their terms of use.

 Key Rate Limits : 
     - OpenStreetMap: 10 Calls per second | 20,000 Calls per day, no key needed
     - LocationIQ:  1 call per second | 10.000 Calls per day, on the free account, non commercial.
     - Mapquest: 15,000 requests per month on the free plan
     - OpenCage: 2,500 calls per day on the free account.
     - GoogleMaps: unlimited for testing? Be careful of using it massively.

Feeds need to be active in the DB

07 Dec 15:26
Compare
Choose a tag to compare

Updated DB structure. A new table behagunea_app_user feed has been created. Now, when working with the DB, both multimedia and rss feeds need to have the "active" flag in the aforementioned table in order to be parsed. This flags means that at least one user has activated a source feed.

  • A feed is not activated by default when created. -> a future release will add this feature.

Talaia - multimedia parsing capabilities

28 Nov 09:45
Compare
Choose a tag to compare

Change log:

  • bug fixes
  • DB update with new fields required for multimedia feeds
  • Fully working Talaia multimedia feed parser

Behagune-dss2016 last stable

10 Oct 12:30
Compare
Choose a tag to compare

Stable version working on behagunea.dss2016.eu instance. Several bug fixes since v0.8