Warning: pg_query(): Query failed: ERROR: unexpected chunk number 1 (expected 0) for toast value 29512337 in pg_toast_2619 in /dati/webiit-old/includes/database.pgsql.inc on line 138 Warning: ERROR: unexpected chunk number 1 (expected 0) for toast value 29512337 in pg_toast_2619 query: SELECT data, created, headers, expire, serialized FROM cache_page WHERE cid = 'https://www-old.iit.cnr.it/node/18054' in /dati/webiit-old/includes/database.pgsql.inc on line 159 Warning: pg_query(): Query failed: ERROR: unexpected chunk number 1 (expected 0) for toast value 29512337 in pg_toast_2619 in /dati/webiit-old/includes/database.pgsql.inc on line 138 Warning: ERROR: unexpected chunk number 1 (expected 0) for toast value 29512337 in pg_toast_2619 query: SELECT data, created, headers, expire, serialized FROM cache_page WHERE cid = 'https://www-old.iit.cnr.it/node/18054' in /dati/webiit-old/includes/database.pgsql.inc on line 159 WLI: a Web application for Language Identification and evaluation of available tools | IIT - CNR - Istituto di Informatica e Telematica
IIT Home Page CNR Home Page

WLI: a Web application for Language Identification and evaluation of available tools

Web Language Identi er (WLI) is a service that, startingfrom the URL of a Web page or a plain text and exploiting a pool oflanguage identi fication tools, returns a set of candidate languages witha confi dence score. Currently embedded tools are Chromium CompactLanguage Detector, Lingua::Identify, and a simple one based on HTML attributes. The service can be exploited through a Web application orvia an API. To globally evaluate the identi fiers, we constructed a test set of Web pages extracted from 146 Wikipedia projects. This allows using WLI also as a service to compare language identi fication tools in terms of supported languages and precision of the results. The charts summarizing the comparison can be visualized in the WLI Web application. We plan to extend the service making it possible for the users to add their own identifi er.


2012

Autori IIT:

Mariantonietta Noemi La Polla

Foto di Mariantonietta Noemi La Polla

Tipo: TR Rapporti tecnici
Area di disciplina: Computer Science & Engineering
IIT TR-18/2012

File: TR-18-2012.pdf

Attività: Multilingual Web