Text Mining Course for KNIME Analytics Platform

Home , Hierarchical clustering, KNIME, Orange (software), Text mining

KNIME AG

1. The Open Analytics Platform 2. The Text Processing Extension 3. Importing Text 4. Enrichment 5. Preprocessing 6. Transformation 7. Classification 8. Visualization 9. Clustering 10. Supplementary Workflows

• A tool for data analysis, manipulation, visualization, and reporting • Based on the graphical programming paradigm • Provides a diverse array of extensions: • Text Mining • Network Mining • Cheminformatics • Many integrations, such as Java, tag">R, Python, Weka, H2O, etc.

NODES perform tasks on data Not Configured Configured Outputs Inputs Executed Status Error

Nodes are combined to create WORKFLOWS

• Databases • MySQL, MS SQL Server, PostgreSQL • any JDBC (Oracle, DB2, …) • Files • CSV, txt • Excel, Word, PDF • SAS, SPSS • XML, JSON • PMML • Images, texts, networks, chem • Web, Cloud • REST, Web services • Twitter, Google

• Spark • HDFS support • Hive • Impala • Vertica • In-database processing

• Preprocessing • Row, column, matrix based • Data blending • Join, concatenate, append • Aggregation • Grouping, pivoting, binning • Feature Creation and Selection

• Regression • Linear, logistic • Classification • Decision tree, ensembles, SVM, MLP, Naïve Bayes • Clustering • k-means, DBSCAN, hierarchical • Validation • Cross-validation, scoring, ROC • Deep Learning • Keras, DL4J • External • R, Python, Weka, H2O

• Interactive Visualizations • JavaScript-based nodes – Scatter Plot, Box Plot, Line Plot – Networks, ROC Curve, Decision Tree – Adding more with each release! • Misc • Tag cloud, open street map, molecules • Script-based visualizations • R, Python

• Database • Files • Excel, CSV, txt • XML • PMML • to: local, KNIME Server, SSH-, FTP-Server • BIRT Reporting

Licensed under a Creative Commons Attribution- ® Copyright © 2018 KNIME AG 11 Noncommercial-Share Alike license 9 https://creativecommons.org/licenses/by-nc-sa/4.0/ Over 1500 native and embedded nodes included:

Data Access Transformation Analysis & Mining Visualization Deployment MySQL, Oracle, ... Row Statistics R via BIRT SAS, SPSS, ... Column Data Mining JFreeChart PMML Excel, Flat, ... Matrix Machine Learning JavaScript XML, JSON Hive, Impala, ... Text, Image Web Analytics Community / 3rd Databases XML, JSON, PMML Time Series Text Mining Excel, Flat, etc. Text, Doc, Image, ... Java Network Analysis Text, Doc, Image Web Crawlers Python Social Media Analysis Industry Specific Industry Specific Community / 3rd R, Weka, Python Community / 3rd Community / 3rd Community / 3rd

• Installing KNIME Analytics Platform • The KNIME Workspace • The KNIME File Extensions • The KNIME Workbench • Workflow editor • Explorer • Node repository • Node description • Installing new features

• Select the KNIME version for your computer: • Mac, Win, or Linux and 32 / 64bit • Download archive and extract the file, or download installer package and run it

• Use the shortcut created by the installer

• Or go to the installation directory and launch KNIME via the knime.exe

• The workspace is the folder/directory in which workflows (and potentially data files) are stored for the current KNIME session. • Workspaces are portable (just like KNIME)

KNIME Explorer Workflow Editor

Node Recommendations

Node Description Node Repository Console

Outline

• In LOCAL you can access your own workflow projects. • The Explorer toolbar on the top has a search box and buttons to – select the workflow displayed in the active editor – refresh the view

• The KNIME Explorer can contain 4 types of content: – Workflows – Workflow groups – Data files – Metanode templates

Licensed under a Creative Commons Attribution- ® Copyright © 2018 KNIME AG 19 Noncommercial-Share Alike license https://creativecommons.org/licenses/by-nc-sa/4.0/ Creating New Workflows, Importing and Exporting

• Right-click in KNIME Explorer to create new workflow or workflow group or to import workflow • Right-click on workflow or workflow group to export

• The Node Repository lists all KNIME nodes

• The search box has 2 modes – Standard Search – exact match of node name – Fuzzy Search – finds the most similar node name

• Nodes can be added by drag and drop from the Node Repository to the Workflow Editor.

• Console view prints out error and warning messages about what is going on under the hood.

• Click on View and select Other… to add different views – Node Monitor, Licenses, etc.

• The Node Description window gives information about: – Node Functionality – Input & Output – Node Settings – Ports – References to literature

Recommendation engine – Gives hints about which node use next in the workflow – Based on KNIME communities' usage statistics – Based on own KNIME workflows

The buttons in the toolbar can be used for the active workflow. The most important buttons: – Execute selected and executable nodes (F7) – Execute all executable nodes – Execute selected nodes and open first view – Cancel all selected, running nodes (F9) – Cancel all running nodes

• Dedicated file extensions for Workflows and Workflow groups associated with KNIME Analytics Platform

• *.knwf for KNIME Workflow Files

• *.knar for KNIME Archive Files

A node can have 3 states: Not Configured: The node is waiting for configuration or incoming data.

Configured: The node has been configured correctly, and can be executed.

Executed: The node has been successfully executed. Results may be viewed and used in downstream nodes.

• Insert nodes into workspace by dragging them from Node Repository or by double-clicking in Node Repository • Connect nodes by left-clicking output port of Node A and dragging the cursor to (matching) input port of Node B • Common port types:

Model Flow Variable Image

Database Database Data Conection Query

• Most nodes require configuration • To access a node configuration window: • Double-click the node • Right-click > Configure

• Right-click node • Select Execute in context menu • If execution is successful, status shows green light • If execution encounters errors, status shows red light

• Right-click node • Select Views in context menu • Select output port to inspect execution results

Plot View

Data View

Licensed under a Creative Commons Attribution- ® Copyright © 2018 KNIME AG 31 Noncommercial-Share Alike license 29 https://creativecommons.org/licenses/by-nc-sa/4.0/ Getting Started: KNIME Example Server

• Public repository with large selection of example workflows for many, many applications • Connect via KNIME Explorer

• Workflows from Example Server also available online – https://www.knime.com/nodeguide

Task Hot key Description Node Configuration F6 opens the configuration window of the selected node F7 executes selected configured nodes Shift + F7 executes all configured nodes Node Execution Shift + F10 executes all configured nodes and opens all views F9 cancels selected running nodes Shift + F9 cancels all running nodes Ctrl + Shift + Arrow moves the selected node in the arrow direction Move Nodes and Ctrl + Shift + moves the selected annotation in the front or in the back Annotations PgUp/PgDown of all overlapping annotations F8 resets selected nodes Ctrl + S saves the workflow Workflow Operations Ctrl + Shift + S saves all open workflows Ctrl + Shift + W closes all open workflows Meta-node Shift + F12 opens meta-node wizard

KNIME pages (www.knime.org) • SOLUTIONS for example workflows • RESOURCES/LEARNING HUB www.knime.org/learning-hub • RESOURCES/NODE GUIDE https://www.knime.org/nodeguide

KNIME Tech pages (tech.knime.org) • FORUM for questions and answers • DOCUMENTATION for docs, FAQ, changelogs, ... • COMMUNITY CONTRIBUTIONS for dev instructions and third party nodes KNIME TV on YouTube https://www.youtube.com/user/KNIMETV

• Classification of free-text documents is a common task in the field of text mining.

• It is used to categorize documents, i.e. assign pre-defined topics, or it can be used for sentiment analysis.

• Today we want to construct a workflow that reads and preprocesses text documents, transforms them into a numerical representation and builds a predictive model to assign pre-defined labels to documents.

• Additional tasks: – Sentiment analysis – Visualization of documents – Document clustering

Title Rating

Author Fulltext

Goal: • Build a classifier to distinguish between reviews about Italian or Chinese restaurants. Review about an Italian or a Chinese restaurant?

1.) 2.) KNIME & Extensions -> KNIME Textprocessing

• Increase maximum memory for KNIME • Edit knime.ini – Add “-Xmx3G” as last line of knime.ini file – Replace 3 by the amount of gigabytes allocated for KNIME

• Useful additional extensions – Palladian (community extension) • Web crawling, Text Mining – XML-Processing (KNIME extension) • Parsing and processing of XML documents

Classifi- cation

… perhaps your name Cluster is -ing Rumpelstiltskin[Perso Visualizatio n] ? … n

… perhaps your name is Rumpelstiltskin[Perso 1 1 1 0 1 0 0 1 1 n] ? … 0 1 1 0 0 1 0 0 0 0 0 1 1 1 0 1 1 0

• Document Cell – Encapsulates a document • Title, sentences, terms, words • Authors, category, source • Generic meta data (key, value pairs) • Term Cell – Encapsulates a term • Words, tags

• Document table – List of documents

• Bag of words – Tuples of documents and terms

• Document vectors – Numerical representations of documents

• Open KNIME • Import workflows from USB stick

• Typically characterized by: – Orange color – No input ports, 1 output port

Output port Status

Node name

• Workhorse of the KNIME Source nodes – Reads text based files – Many advanced features allow it to read most ‘weird’ files

File path

Basic Settings Advanced Settings

Help Preview button

• Reads .xls and .xlsx file from Microsoft Excel – Supports reading from multiple sheets

File path

Sheet specific settings

Preview

• Reads tables from the native KNIME Format • Maximum performance • Minimum configuration

File path

• Connectors for Common DB types (MySQL, Postgres, SQLite) • Also works with any jdbc driver • Common nodes for SQL Query Building (Groupby, Join, Filter, Sort)

• PMML Reader – reads standard predictive models • XML Reader with XPATH support • REST/SOAP, and many more

• Node Repository: Other Data Types/Text Processing/IO • Available Parser Nodes – Flat File Document Parser – PDF Parser – Word Parser – Document Grabber – …

• Reads files of various formats from directory – Searches for all files with specified extension in directory – Creates one document for each file – Extracts specified (meta) information