Plasma Active & Contour A new activity based mobile user interface with Plasma and Nepomuk Talk by Marco Martin & Fania Jöck Sponsored by: Plasma Active & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 1 Big picture Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 2 08.08.2011 Marco Martin, Fania Jöck Seite 2 Project Plasma Active A new activity based Activities - the helpful Big mobile user interface with Brother Plasma and Nepomuk Ivan Čukić Mon, 14:00 - 14:30 Marco Martin, Fania Jöck Audimax Mon, 10:20 - 10:50 Audimax Plasma Active - Conquering Compositing after X - KWin the Device Spectrum on the Road to Wayland Sebastian Kügler Martin Gräßlin Sun, 09:40 - 10:10 Sat, 14:00 - 14:30 Kinosaal Rm2002 Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 3 08.08.2011 Marco Martin, Fania Jöck Seite 3 Who are we? Plasma Active Share Plasma Active Contour Like Mobile Apps Connect Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 4 08.08.2011 Marco Martin, Fania Jöck Seite 4 What is this all about? desktop context-sensitive KDE touchmultidevice workspaces tablets user interface UXmobile Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 5 08.08.2011 Marco Martin, Fania Jöck Seite 5 Why should we need that? User adapts to the system The system adapts to the user Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 6 08.08.2011 Marco Martin, Fania Jöck Seite 6 What is new in Contour? I Informations + Actions = Activity – information on the system linked with actions – user chooses those activities instead of applications – system learns and analyses usage patterns (actions and events) I Smart recommendations – system provides dynamic data based on patterns and on context – analysis of timeline (past, present and future) – priorization, big change in user behavior Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 7 08.08.2011 Marco Martin, Fania Jöck Seite 7 Concept Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 8 08.08.2011 Marco Martin, Fania Jöck Seite 8 Concept of Contour Pattern Context Activity Recommendations Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 9 08.08.2011 Marco Martin, Fania Jöck Seite 9 Concept Context = geo location, time, active files and applications, current activity, recent action history Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 10 08.08.2011 Marco Martin, Fania Jöck Seite 10 Concept Patterns = regular actions of the user in similar contexts Context = geo location, time, active files and applications, current activity, recent action history Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 11 08.08.2011 Marco Martin, Fania Jöck Seite 11 Concept Patterns = regular actions of the user in similar contexts Context = geo location, Activities time, active files = individualized and applications, Activity work spaces that current activity, contain resources recent action like files, contacts, history applications Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 12 08.08.2011 Marco Martin, Fania Jöck Seite 12 Concept Patterns = regular actions of the user in similar contexts Context = geo location, Activities time, active files = individualized and applications, Activity work spaces that current activity, contain resources recent action like files, contacts, history applications propositions for actions that are Recommendations dynamicly changing to context, based on the detected patterns Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 13 08.08.2011 Marco Martin, Fania Jöck Seite 13 Context Pattern Context Activity Recommendations = geo location, time, current activity, active files and applications, recent action history Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 14 08.08.2011 Marco Martin, Fania Jöck Seite 14 Patterns Pattern Context Activity Recommendations = regular actions of the user in similar contexts Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 15 08.08.2011 Marco Martin, Fania Jöck Seite 15 Activity Pattern Context Activity Recommendations = individualized work spaces that contain resources like files, contacts, applications Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 16 08.08.2011 Marco Martin, Fania Jöck Seite 16 Recommendations Recommendations Recommendations Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 17 08.08.2011 Marco Martin, Fania Jöck Seite 17 Somebody already had that idea... Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 18 08.08.2011 Marco Martin, Fania Jöck Seite 18 Smart adaptions – Activity Switcher ...adapts to current context At home At university Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 19 08.08.2011 Marco Martin, Fania Jöck Seite 19 Smart adaptions – Context Menu ...adapts to object type and last events For documents For contacts Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 20 08.08.2011 Marco Martin, Fania Jöck Seite 20 Smart adaptions – recommendation overlay ... adapts to current activity and recent action history Grandma just called Writing the invitation Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 21 08.08.2011 Marco Martin, Fania Jöck Seite 21 Interface Design Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 22 08.08.2011 Marco Martin, Fania Jöck Seite 22 Different zones Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 23 08.08.2011 Marco Martin, Fania Jöck Seite 23 Different zones Recommendation Overlay Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 24 08.08.2011 Marco Martin, Fania Jöck Seite 24 Different zones Activity Screen Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 25 08.08.2011 Marco Martin, Fania Jöck Seite 25 Different zones Top Bar Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 26 08.08.2011 Marco Martin, Fania Jöck Seite 26 Different zones Activity Switcher Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 27 08.08.2011 Marco Martin, Fania Jöck Seite 27 Live Demo Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 28 08.08.2011 Marco Martin, Fania Jöck Seite 28 Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 29 08.08.2011 Marco Martin, Fania Jöck Seite 29 Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 30 08.08.2011 Marco Martin, Fania Jöck Seite 30 Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 31 08.08.2011 Marco Martin, Fania Jöck Seite 31 Technical background Contour 08.08.11 VisionPlasma & Concept Active & Contour Seite 32 08.08.2011 Marco Martin, Fania Jöck Seite 32 Plasma perspective: data I Metadata dataengine I Activity manager daemon and the recommendations dataengine I Those are sources for: – Nepomuk resources connected to the current activity – Recommendations (resources with high scoring/actions associated to them) Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 33 Visualization I PlasmaMobile shell I QML packages used for independent, big components (almost blackbox, opposed to imports) – Homescreen: first thing loaded from the shell – Activity switcher – Recommendations overlay I Containments – Activity screen – Panel – Window switcher – Launcher Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 34 Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 35 Plasma mobile booting I QML homescreen loaded I The appletsrc config file gets loaded I All containment restored: I Systray, window switcher and launcher containments go in a partially offscreen panel I The main screen “Planar” containment gets restored – In the case of Contour they are instances of the Current activity screen – Transition between activity containments will be managed by a QML animation Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 36 Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 37 Activity screen Containment I QML-only Applet/Containment I Uses the metadata dataengine PlasmaCore.DataSource { id: metadataSource engine: "org.kde.active.metadata" interval: 0 connectedSources: ["CurrentActivityResources:"+plasmoid.activityId] } Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 38 Activity Resources I The source "CurrentActivityResources:activity id” executes: Nepomuk::Resource acRes("activities://" + activityId); Nepomuk::Query::ComparisonTerm term(Soprano::Vocabulary::NAO::isRelated(), Nepomuk::Query::ResourceTerm(acRes)); term.setInverted(true); Nepomuk::Query::Query query = Nepomuk::Query::Query(term); I The property isRelated gets assigned by the user with a search screen implemented in the containment itself or with the SLC mechanism Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck Seite 39 Containment layout I Resources splitted by category: proxy model I Space divided in cells, internal data structure to keep track of busy/taken ones I User moves/resizes a box: JS function invoked that performs a simple lookup of the nearest free cell (back and forward) I The box gets aligned to the nearest free space to the dropped position, resized if necessary I A Behavior on geometry properties ensures it happens with a smooth animation I Plasmoids are positioned in the same way Contour VisionPlasma & ConceptActive & Contour 08.08.2011 Marco Martin, Fania Jöck