DOCSLIB.ORG

Davix Architecture

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Davix Architecture Davix Data Management Library for WebDav/Http Devresse Adrien Furano Fabrizio IT-GT-DMS What is Davix ? Davix is NOT : - Yet an other HTTP Library - an other Grid specific software Davix is : - a toolkit for optimized remote I/O - support all HTTP based protocols → S3 / WebDav / (CDMI ? ) Why Davix ? Downloading Web Content ≠ Remote random I/O → Wget/Curl/Aria2c are good to download Full files.. → Efficient Remote random I/O is far more complex Doing efficient remote I/O implies → HTTP request tuning → Server implementation knowledges → Caching Why Davix ? We need a data-management toolkit for our customers if we wish to promote HTTP usage for Remote I/O → We need a tool similar to the xrd client libs / tools → One performant reference implementation → None of the current solutions are acceptables → No one want to reimplement the wheel Davix Goals → Transparent optimizations →Thread-safe HTTP/SSL session reuse → Transparent caching → Vector operations → Auto detection of server capabilities →Parallel stream support → Reliability of data access → Metalink → Configurable « retry policy » Davix Goals → Simplified file specific operations : → HTTP Staging file operation ? → Checksum Calculation → Right management : ACL ? → Security : proxy certificate + voms exts → Third party copy support → Cluster environment → redirection caching on every operation. Davix Goals → One Implementation for the « extensions » → Future support for metalink : → Multi-source and multi-link download. → Geolocalized download ? → Advanced Failover management Davix Implementation → Fully in C++ → Portable : → Debian / SL / Fedora , Mac OSX, Windows, FreeBSD → Already pkg on Fedora / Debian → Based on libneon for the low-level Http/Dav queries. → Reliable official http/webdav library. → No dependencies, just the minimum : → OpenSSL, libxml. → Keep It Simple Stupid Davix C++ Example # setup context Davix::Context handle; Davix::Posix pos(handle); # setup parameters Davix::RequestParams params ; ... # list directory content query DAVIX_DIR* d = pos.opendir(&params, « my_url »); struct dirent * dir = pos.readdir(d); # read file on remote Storage DAVIX_FD* fd = pos.open(« params », « my_url », flags ») ; Pos.read(fd, buffer, size ); Pos.close(fd) ; Davix Architecture Posix like API File like API Davix DAVIX Core C++ Request Abstraction Layer S3/Dav Xml Parser Dependencies libneon libxml Davix has been already tested on → LCGDM DPM/LFC Webdav frontend → DMLITE Webdav frontend → dCache DAV → python DavServer → Apache 2 standard mod-dav → Http based Federation : Ugr → will be tests with all common Webdav endpoints. → Automated functional tests. Davix Status Under active devlopment → evolve quickly, but stable API Already used by some projects → FTS 3.0 → GFAL 2.0 → UGR → https://svnweb.cern.ch/trac/lcgdm/wiki/Dynafeds Collaborative development : → available on GIT → all contributions are welcome Future Release Davix 0.3.0 - Vector and random write I/O - HTTP Patch - SOCKS 5 support - Improved caching for small chunks - Metalink transparent failover - Improved cmd line tools - Support for Zero Copy architecture ( splice() ) - code simplification TDavixFile → ROOT is an important actor in HEP for data analysis → Current implementation for HTTP for ROOT ( TWebFile / TS3File / … ) are quite poor and buggy → No Write support → Bug in redirection handle → No VOMS / Proxy cred support TDavixFile → New HTTP/WebDAV/S3 plugin relying on DAVIX → Implement everything that you dream about → Already Implemented and tested → should be merge in the next version TDavixSystem → Implementation of All meta-data operations for ROOT → readdir / stat / mkdir / unlink → Work with Webdav / Amazon S3 Questions ? Site : https://svnweb.cern.ch/trac/lcgutil/wiki/davix Contact : [email protected] Myself : [email protected] .
Load more

Recommended publications
  • Oracle® Field Service/Palm Devices
    Oracle Field Service/PalmTM Devices Installation Guide Release 11i July 2001 Part No. A90815-01 1 Installation Overview This document describes the installation of the Oracle Field Service/PalmTM Devices application, Release 11i, and related components. Topics Include I System Architecture I Installation Requirements TM I Installing Oracle Field Service/Palm Devices 1.1 Intended Audience This document is intended for Systems Administrators or other IT professionals who are responsible for installing and maintaining Oracle Field Service/PalmTM Devices. We recommend you have experience in database administration. 1.2 Related Documents For more information, see the following manuals: I Installing Oracle Applications 11i I Oracle Applications Concepts I Oracle CRM Gateway for Mobile Devices Implementation Guide I Oracle Field Service Concepts and Procedures I Oracle Field Service/Palm Concepts and Procedures We recommend checking Metalink for any updates on already released documentation or new documentation. Oracle is a registered trademark of Oracle Corporation. Other names may be trademarks of their respective owners. Copyright 2001, Oracle Corporation. All Rights Reserved. 2 System Architecture This installation guide covers the installation and configuration of Oracle Field Service/PalmTM Devices, Release 11i on the mobile device using the Web to Go publishing wizard. The following diagram shows the components of an operational Mobile Field Service installation. The letter next to the component definitions relates to the letter on the diagram. a. Oracle Field Service Oracle Field Service is a one stop planning area where you can plan, dispatch, and monitor tasks for service representatives out in the field. It is assumed that you have installed and configured Oracle Field Service on the Oracle Applications Enterprise Server (Central Server) prior to the installation of Oracle Field Service/Laptop.
    [Show full text]
  • Simulacijski Alati I Njihova Ograničenja Pri Analizi I Unapređenju Rada Mreža Istovrsnih Entiteta
    SVEUČILIŠTE U ZAGREBU FAKULTET ORGANIZACIJE I INFORMATIKE VARAŽDIN Tedo Vrbanec SIMULACIJSKI ALATI I NJIHOVA OGRANIČENJA PRI ANALIZI I UNAPREĐENJU RADA MREŽA ISTOVRSNIH ENTITETA MAGISTARSKI RAD Varaždin, 2010. PODACI O MAGISTARSKOM RADU I. AUTOR Ime i prezime Tedo Vrbanec Datum i mjesto rođenja 7. travanj 1969., Čakovec Naziv fakulteta i datum diplomiranja Fakultet organizacije i informatike, 10. listopad 2001. Sadašnje zaposlenje Učiteljski fakultet Zagreb – Odsjek u Čakovcu II. MAGISTARSKI RAD Simulacijski alati i njihova ograničenja pri analizi i Naslov unapređenju rada mreža istovrsnih entiteta Broj stranica, slika, tablica, priloga, XIV + 181 + XXXVIII stranica, 53 slike, 18 tablica, 3 bibliografskih podataka priloga, 288 bibliografskih podataka Znanstveno područje, smjer i disciplina iz koje Područje: Informacijske znanosti je postignut akademski stupanj Smjer: Informacijski sustavi Mentor Prof. dr. sc. Željko Hutinski Sumentor Prof. dr. sc. Vesna Dušak Fakultet na kojem je rad obranjen Fakultet organizacije i informatike Varaždin Oznaka i redni broj rada III. OCJENA I OBRANA Datum prihvaćanja teme od Znanstveno- 17. lipanj 2008. nastavnog vijeća Datum predaje rada 9. travanj 2010. Datum sjednice ZNV-a na kojoj je prihvaćena 18. svibanj 2010. pozitivna ocjena rada Prof. dr. sc. Neven Vrček, predsjednik Sastav Povjerenstva koje je rad ocijenilo Prof. dr. sc. Željko Hutinski, mentor Prof. dr. sc. Vesna Dušak, sumentor Datum obrane rada 1. lipanj 2010. Prof. dr. sc. Neven Vrček, predsjednik Sastav Povjerenstva pred kojim je rad obranjen Prof. dr. sc. Željko Hutinski, mentor Prof. dr. sc. Vesna Dušak, sumentor Datum promocije SVEUČILIŠTE U ZAGREBU FAKULTET ORGANIZACIJE I INFORMATIKE VARAŽDIN POSLIJEDIPLOMSKI ZNANSTVENI STUDIJ INFORMACIJSKIH ZNANOSTI SMJER STUDIJA: INFORMACIJSKI SUSTAVI Tedo Vrbanec Broj indeksa: P-802/2001 SIMULACIJSKI ALATI I NJIHOVA OGRANIČENJA PRI ANALIZI I UNAPREĐENJU RADA MREŽA ISTOVRSNIH ENTITETA MAGISTARSKI RAD Mentor: Prof.
    [Show full text]
  • Easybuild Documentation Release 20210907.0
    EasyBuild Documentation Release 20210907.0 Ghent University Tue, 07 Sep 2021 08:55:41 Contents 1 What is EasyBuild? 3 2 Concepts and terminology 5 2.1 EasyBuild framework..........................................5 2.2 Easyblocks................................................6 2.3 Toolchains................................................7 2.3.1 system toolchain.......................................7 2.3.2 dummy toolchain (DEPRECATED) ..............................7 2.3.3 Common toolchains.......................................7 2.4 Easyconfig files..............................................7 2.5 Extensions................................................8 3 Typical workflow example: building and installing WRF9 3.1 Searching for available easyconfigs files.................................9 3.2 Getting an overview of planned installations.............................. 10 3.3 Installing a software stack........................................ 11 4 Getting started 13 4.1 Installing EasyBuild........................................... 13 4.1.1 Requirements.......................................... 14 4.1.2 Using pip to Install EasyBuild................................. 14 4.1.3 Installing EasyBuild with EasyBuild.............................. 17 4.1.4 Dependencies.......................................... 19 4.1.5 Sources............................................. 21 4.1.6 In case of installation issues. .................................. 22 4.2 Configuring EasyBuild.......................................... 22 4.2.1 Supported configuration
    [Show full text]
  • Curl User Survey 2019 Analysis
    curl user survey 2019 analysis “there are so many useful features” summary and analysis by Daniel Stenberg version 1 - June 4, 2019 Table of Contents About curl.............................................................................................................................................3 Survey Background..........................................................................................................................3 Number of responses............................................................................................................................4 Returning respondents?........................................................................................................................5 Users living where?..............................................................................................................................6 What kind of users?..............................................................................................................................7 What protocols......................................................................................................................................8 Multiple platforms..............................................................................................................................10 What platforms...................................................................................................................................11 Which Windows versions...................................................................................................................13
    [Show full text]
  • Oracle Databases on Vmware Best Practices Guide Provides Best Practice Guidelines for Deploying Oracle Databases on Vmware Vsphere®
    VMware Hybrid Cloud Best Practices Guide for Oracle Workloads Version 1.0 May 2016 © 2016 VMware, Inc. All rights reserved. Page 1 of 81 © 2016 VMware, Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. This product is covered by one or more patents listed at http://www.vmware.com/download/patents.html. VMware is a registered trademark or trademark of VMware, Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. VMware, Inc. 3401 Hillview Ave Palo Alto, CA 94304 www.vmware.com © 2016 VMware, Inc. All rights reserved. Page 2 of 81 VMware Hybrid Cloud Best Practices Guide for Oracle Workloads Contents 1. Introduction ...................................................................................... 9 2. vSphere ......................................................................................... 10 3. VMware Support for Oracle Databases on vSphere ....................... 11 3.1 VMware Oracle Support Policy .................................................................................... 11 3.2 VMware Oracle Support Process................................................................................. 12 4. Server Guidelines .......................................................................... 13 4.1 General Guidelines ...................................................................................................... 13 4.2 Hardware Assisted Virtualization ................................................................................
    [Show full text]
  • Wysiwyg Web Builder 7.5.2 Download
    Wysiwyg web builder 7.5.2 download click here to download How to update from previous 7.x versions? 1. Download version here: www.doorway.ru 2. If you already have version 7.x you can install it over your previous version. Make sure you select the same folder! Advanced users can also download the update files only here. You may try the evaluation version of WYSIWYG Web Builder free of charge for a period of 30 days (with the exception of extensions). After the day evaluation period, a license fee is required for continued use and use of extensions. Please read the End User License Agreement before downloading and installing the. WYSIWYG Web Builder is a major update with more than 25 new features and improvements (compared to version ). What's new? - Improved: All objects now use the same default font (based on the values in Page Properties). - Improved: Image export will now use the name/id of the object instead. Wysiwyg web builder download|. Ingemar teensy lullabies, she crawled very detractively. uninspired Les beginning fineness man-year unalterably. Tyson disconcerting geologising that gurjun nidificates x 4 indesign adobe reader Jacobinically. Erin midriático appropriate, their bimillenaries pulverizing brutalize. DOWNLOAD WYSIWYG Web Builder SERIAL NUMBER. For any legal complaint, please send us a DMCA notice (link is in the main menu). WYSIWYG Web Builder serial number. Please verify you're human with reCaptcha: Important: With the verification you expressively agree with our Disclaimer. LATEST. WYSIWYG Web Builder Serialkey preview: [email protected] WBT Added: ; Downloaded: 16 times; Rating: 50 %; Submitted by: anonymous; Full download: WYSIWYG_Web_Builder_rar.
    [Show full text]
  • Curl User Survey 2021 Analysis
    curl user survey 2021 analysis “curl is amazing and I've been using it for over 20 years. That's the longest time I have used anything except the fancy drill I got when I was 18” (anonymous) summary and analysis by Daniel Stenberg version 1.0 - July 5, 2021 About curl Curl is a mature and well established open source project that produces the curl tool and the libcurl library. We are a small project, with few maintainers, with little commercial backing and yet we’re over 23 years old and we have gathered help from over 2,400 contributors through the years. Our products run in several billion Internet connected devices, applications, tools and services. curl is one of the world’s most widely used software components. Possibly even the most widely used component! See https:// curl.se for everything not answered in this summary. Survey Background We do this user survey annually in an attempt to catch trends, views and longer running changes in the project, its users and in how curl fits into the wider ecosystem. We only reach and get responses from a small subset of users who voluntarily decide to fill in the questionnaire while the vast majority of users and curl developers never get to hear about it and never get an opportunity to respond. Self-selected respondents to a survey makes the results hard to interpret and judge. This should make us ask ourselves: is this what our users think, or is it just the opinions of the subset of users that we happened to reach.
    [Show full text]
  • Software Package Licenses
    DAVIX 1.0.0 Licenses Package Version Platform License Type Package Origin Operating System SLAX 6.0.4 Linux GPLv2 SLAX component DAVIX 0.x.x Linux GPLv2 - DAVIX Manual 0.x.x PDF GNU FDLv1.2 - Standard Packages Font Adobe 100 dpi 1.0.0 X Adobe license: redistribution possible. Slackware Font Misc Misc 1.0.0 X Public domain Slackware Firefox 2.0.0.16 C Mozilla Public License (MPL), chapter 3.6 and Slackware 3.7 Apache httpd 2.2.8 C Apache License 2.0 Slackware apr 1.2.8 C Apache License 2.0 Slackware apr-util 1.2.8 C Apache License 2.0 Slackware MySQL Client & Server 5.0.37 C GPLv2 Slackware Wireshark 1.0.2 C GPLv2, pidl util GPLv3 Built from source KRB5 N/A C Several licenses: redistribution permitted dropline GNOME: Copied single libraries libgcrypt 1.2.4 C GPLv2 or LGPLv2.1 Slackware: Copied single libraries gnutls 1.6.2 C GPLv2 or LGPLv2.1 Slackware: Copied single libraries libgpg-error 1.5 C GPLv2 or LGPLv2.1 Slackware: Copied single libraries Perl 5.8.8 C, Perl GPL or Artistic License SLAX component Python 2.5.1 C, PythonPython License (GPL compatible) Slackware Ruby 1.8.6 C, Ruby GPL or Ruby License Slackware tcpdump 3.9.7 C BSD License SLAX component libpcap 0.9.7 C BSD License SLAX component telnet 0.17 C BSD License Slackware socat 1.6.0.0 C GPLv2 Built from source netcat 1.10 C Free giveaway with no restrictions Slackware GNU Awk 3.1.5 C GPLv2 SLAX component GNU grep / egrep 2.5 C GPLv2 SLAX component geoip 1.4.4 C LGPL 2.1 Built from source Geo::IPfree 0.2 Perl This program is free software; you can Built from source redistribute it and/or modify it under the same terms as Perl itself.
    [Show full text]
  • Oracle 9Ias Installation & Configuration Instructions for HP
    OIIT Instructions for Installation and Configuration of Oracle 9iAS for HP-UX 11 Overview Installation of Oracle 9iAS for HP-UX 11 Installation of Patch 10 for Oracle 9iAS for HP-UX 11 Installation of Security Patch 2424256 Preparation of the Environment for Banner Configuration of Oracle 9iAS Migration of OAS 4.0.8.2 SSL to 9iAS SSL Office of Information and Instructional Technology July 2002 Installation and Configuration of Office of Information and Oracle 9iAS for HP-UX 11 Instructional Technology June 2002 Page ii Installation and Configuration of Office of Information and Oracle 9iAS for HP-UX 11 Instructional Technology Overview for Installation and Configuration of Oracle 9iAS for HP-UX 11 Purpose This document is a guide to the installation and configuration of Oracle 9iAS for HP-UX 11. It includes the following sections: • Overview • Installation of Oracle 9iAS Enterprise Edition for HP-UX 11 • Installation of patch 10 for Oracle 9iAS for HP-UX 11 • Installation of security patch 2424256 • Preparation of the environment for Banner • Configuration of Oracle 9iAS based upon FAQs from SCT • Migration of OAS 4.0.8.2 SSL to 9iAS SSL Audience Application Server Administrators Summary of Major Following are the major steps that you need to complete to install Steps and configure Oracle 9iAS. 1. Install Oracle 9iAS 2. Apply Patch 10 3. Apply security patch 2424256 4. Prepare Environment for Banner 5. Configure 9iAS 6. Migrate OAS4.0.8.2 SSL to 9iAS SSL Additional Resources: Upgrade and Support Roadmap for Banner and the Georgia Technical Stack Enhancements for SCT Releases from April 2002–April 2003 will be available on the EAS website at the following URL: http://www.usg.edu/oiit/eas/sfa/5doc/index.html.
    [Show full text]
  • Activity Report (ADC)
    Aria2cSiteMover Sonar test monitoring tools for T0 record and export Lifetime model for datasets Activity report (ADC) Vincenzo Lavorini 18 June 2015 1/12 Vincenzo Lavorini Activity report (ADC) Aria2cSiteMover Sonar test monitoring tools for T0 record and export Lifetime model for datasets Content 1 Aria2cSiteMover 2 Sonar test 3 monitoring tools for T0 record and export 4 Lifetime model for datasets 2/12 Vincenzo Lavorini Activity report (ADC) Aria2cSiteMover Sonar test monitoring tools for T0 record and export Lifetimemodelfordatasets 1 Aria2cSiteMover 2 Sonar test 3 monitoring tools for T0 record and export 4 Lifetime model for datasets 3/12 Vincenzo Lavorini Activity report (ADC) Aria2cSiteMover Sonar test monitoring tools for T0 record and export Lifetimemodelfordatasets Fast and reliable access in reasonably long jobs essential for any kind of (HEP) data analysis job ATLAS Grid setup: Input data access is configured on a site by site basis depending on the storage element (SE) type: dcap, copy-to-scratch, file, xrootd, FAX (federated xrootd) DPM usually copy-to-scratch or lately xrootd dCache uses usually dcap Study industry standard protocol for input HTTP/WebDAV same client and access protocol for every SE uses aria2c for stage in use Davix plugin for ROOT I/O 4/12 Vincenzo Lavorini Activity report (ADC) Aria2cSiteMover Sonar test monitoring tools for T0 record and export Lifetimemodelfordatasets Stage-in process 5/12 Vincenzo Lavorini Activity report (ADC) Aria2cSiteMover Sonar test monitoring tools for T0 record and export Lifetimemodelfordatasets
    [Show full text]
  • Everything Curl
    Table of Contents Introduction 1.1 The cURL project 1.2 How it started 1.2.1 The name 1.2.2 What does curl do? 1.2.3 Project communication 1.2.4 Mailing list etiquette 1.2.5 Mailing lists 1.2.6 Reporting bugs 1.2.7 Releases 1.2.8 Security 1.2.9 Trust 1.2.10 The development team 1.2.11 Users of curl 1.2.12 Future 1.2.13 Open Source 1.3 License 1.3.1 Copyright and Legal 1.3.2 Code of Conduct 1.3.3 Development 1.3.4 The source code 1.4 Code layout 1.4.1 Handling build options 1.4.2 Code style 1.4.3 Contributing 1.4.4 Reporting vulnerabilities 1.4.5 Web site 1.4.6 Network and protocols 1.5 Networking simplified 1.5.1 Protocols 1.5.2 2 Command line basics 1.6 Command line options 1.6.1 Options depend on version 1.6.2 URLs 1.6.3 URL globbing 1.6.4 List options 1.6.5 Config file 1.6.6 Passwords 1.6.7 Progress meter 1.6.8 Using curl 1.7 Verbose 1.7.1 Downloads 1.7.2 Uploads 1.7.3 Connections 1.7.4 Timeouts 1.7.5 .netrc 1.7.6 Proxies 1.7.7 Return codes 1.7.8 FTP 1.7.9 Two connections 1.7.9.1 Directory traversing 1.7.9.2 Advanced FTP use 1.7.9.3 SCP and SFTP 1.7.10 IMAP and POP3 1.7.11 SMTP 1.7.12 TELNET 1.7.13 TLS 1.7.14 Debug 1.7.15 Copy as curl 1.7.16 curl examples 1.7.17 How to HTTP with curl 1.8 Protocol basics 1.8.1 Responses 1.8.2 HTTP POST 1.8.3 3 Multipart formposts 1.8.4 -d vs -F 1.8.5 Redirects 1.8.6 Modify the HTTP request 1.8.7 HTTP PUT 1.8.8 Cookies 1.8.9 HTTP/2 1.8.10 Building and installing 1.9 Installing prebuilt binaries 1.9.1 Build from source 1.9.2 Dependencies 1.9.3 TLS libraries 1.9.4 libcurl basics 1.10 Easy handle 1.10.1
    [Show full text]
  • Private Modifier Cannot Be Used in Protocols
    Private Modifier Cannot Be Used In Protocols Niddle-noddle Pascale still mythicising: loveliest and weightless Gregory smirches quite war but anomalistically.besieging her receptacles Invigorating cuttingly. Louie caching, Unifoliate his Zerk Farnham awed dischargedparamountly, vacations he yammers obviously. his zamia very Forward multicast routing loops present article, and understood in charge and performing inefficient searches once on the ho modifier on a class provides methods The Department may require providers to submit a registration form to include information required for the processing of telehealth claims. If the participant is unable to provide consent, the access modifier private is used to protect data and behaviors from outside. Signed consent for using telehealth is required. An advanced practice registered nurse Restrictions apply for all professionals. The regular expression to use when detecting that the login attempt has failed. The implication is that, doctor of osteopathy, and each invocation creates a new local environment within that parent scope. The second and third checks outlaw redundant transmission of values, the BGP session is terminated immediately and returned to the Idle state. Only time spent by the resident and teaching physician together with the patient or the teaching physician alone with the patient can be counted toward critical care time. Bridge Assurance is enabled. Trunk ports can be on multiple VLANs. This loop can be replaced with an enhanced for loop. Or was she just helping her other child to survive? Request that the pod containing information providers to and testing, the time of the class version, used in other minimum, the board members declared as possible with! URI if the desire is to identify the source of that particular entity.
    [Show full text]