DOCSLIB.ORG

Monk Developer's Reference

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Monk Developer's Reference Monk Developer’s Reference Release 5.0.5 for Schema Run-time Environment (SRE) Copyright © 2005, 2010, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related software documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007). Oracle USA, Inc., 500 Oracle Parkway, Redwood City, CA 94065. This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications which may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure the safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications. Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. UNIX is a registered trademark licensed through X/Open Company, Ltd. This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services. Version 20100713171925. Monk Developer’s Reference 2 Contents Contents Chapter 1 Introduction 16 Document Purpose and Scope 16 Intended Audience 16 Organization of Information 17 Writing Conventions 18 Supporting Documents 19 Chapter 2 Monk Basics 20 Overview 20 Data Types 21 Latent Data Typing 22 Monk Conventions 23 Naming Conventions 23 Identifiers 23 Comments 24 Whitespace 24 Notations 25 Literals 25 Variables 26 Procedure or Function Calls 26 The Use of Characters 26 Entering Interpreted Characters as Literals 27 Characters to be Escaped in Monk Expressions 27 Representing Control Characters in Monk Expressions 27 Representing Octal or Hex Characters as Monk Expressions 28 Regular Expressions 28 The Simplest Regular Expression 28 Building Complex Regular Expressions 28 Regular Expression Operators 29 Regular Expression Examples 30 Format Specification 33 Monk Developer’s Reference 3 Contents Monk and Event Definitions 36 Contents of an Event Definition 36 Structured Events 37 How Monk Uses Paths to Access Structured Events 38 Delimiter List 40 Node List 42 Behavior of Optional Nodes That Contain No Data 48 Dynamic Parsing of Data 49 Referencing an Instance of a Repeating Node 49 Referencing Data with Byte Count 49 Length Specification, When Assigning Data to Structured Event 50 Use of Variables to Represent Path Elements 51 Path to Any-Ordered Set 51 Sample Programs 52 Chapter 3 Control Flow and Boolean Expressions 55 Overview 55 and 56 begin 57 case 58 case-equal 59 cond 60 do 61 do* 63 if 64 not 65 or 66 Chapter 4 Definition, Binding and Assignment 67 define 68 defined? 69 let 70 let* 71 letrec 72 set 73 set! 74 undefine 75 Chapter 5 Character Functions 76 char? 77 char=? 78 char<? 79 char>? 80 char<=? 81 char>=? 82 char-ci=? 83 char-ci<? 84 Monk Developer’s Reference 4 Contents char-ci>? 85 char-ci<=? 86 char-ci>=? 87 char-alphabetic? 88 char-and 89 char-downcase 90 char-lower-case? 91 char-not 92 char-numeric? 93 char-or 94 char-shift-left 95 char-shift-right 96 char-type 97 char-type! 98 char-type? 99 char-upcase 100 char-upper-case? 101 char-whitespace? 102 char-xor 103 Chapter 6 String Functions 104 format 106 htonl->string 107 htons->string 108 list->string 109 make-string 110 regex 111 string 112 string? 113 string<? 114 string<=? 115 string=? 116 string>? 117 string>=? 118 string-append 119 string-append! 120 string-checksum 121 string-ci=? 122 string-ci<? 123 string-ci>? 124 string-ci<=? 125 string-ci>=? 126 string-copy 127 string-copy! 128 string-crc16 129 string-crc32 130 string-downcase 131 string-empty? 132 string-fill! 133 string-insert! 134 string-left-trim 135 string-length 136 string-length! 137 string->list 138 string-lrc 139 string->ntohl 140 string->ntohs 141 string-ref 142 string-right-trim 143 string-set! 144 Monk Developer’s Reference 5 Contents string-substitute 145 string-tokens 146 string-trim 147 string-type 148 string-type! 149 string-type? 150 string-upcase 151 subseq 152 substring-index 153 Chapter 7 Numerical Expressions 154 * 155 + 156 - 157 / 158 < 159 = 160 <= 161 > 162 >= 163 abs 164 acos 165 asin 166 atan 167 big-endian->integer 168 ceiling 169 cos 170 even? 171 exp 172 expt 173 floor 174 gcd 175 integer? 176 integer->big-endian 177 integer->little-endian 178 lcm 179 little-endian->integer 180 log 181 max 182 min 183 modulo 184 negative? 185 number? 186 number->integer 187 number->real 188 number->uint 189 odd? 190 positive? 191 quotient 192 real? 193 remainder 194 round 195 sin 196 sqrt 197 tan 198 truncate 199 uint? 200 zero? 201 Monk Developer’s Reference 6 Contents Chapter 8 Pairs and Lists 202 append 204 assoc 205 assq 206 assv 207 car 208 cdr 209 caar...cddddr 210 cons 211 length 212 list 213 list? 214 list-ref 215 list-tail 216 member 217 memq 218 memv 219 null? 220 pair? 221 reverse 222 set-car! 223 set-cdr! 224 Chapter 9 Vector Expressions 225 Vectors in Monk 225 The Vector Functions 226 list->vector 227 make-vector 228 vector 229 vector? 230 vector->list 231 vector-fill! 232 vector-length 233 vector-ref 234 vector-set! 235 vector->string 236 Chapter 10 Equivalence Testing 237 eq? 238 equal? 240 eqv? 241 Chapter 11 Conversion Procedures 243 number->string 244 string->number 245 Monk Developer’s Reference 7 Contents keyword? 246 string->symbol 247 symbol->string 248 char->integer 249 integer->char 250 Chapter 12 File I/O Expressions 251 clear-port-callback 252 close-port 253 current-debug-port 254 current-error-port 255 current-input-port 256 current-output-port 257 current-warning-port 258 ftell 259 get-port-callback 260 input-string-port? 261 open-append-file 262 open-input-file 263 open-input-string 264 open-output-file 265 open-output-string 266 open-random-access-file 267 output-port? 268 output-string-port? 269 regex-string-port 270 rewind 271 seek-cur 272 seek-set 273 seek-to-end 274 set-file-encoding-method 275 set-port-callback 276 string-port->string 277 eof-object? 278 read 279 read-char 280 read-line 281 display 282 newline 283 write 284 write-char 285 write-exp 286 Chapter 13 System Interface Functions 287 directory 288 file-delete 289 file-exists? 290 file-rename 291 getenv 292 load 293 load-directory 294 load-extension 295 putenv 296 system 297 Monk Developer’s Reference 8 Contents Chapter 14 Standard Procedures 299 Booleans 299 boolean? 300 Symbols 300 keyword? 301 symbol? 302 sys-procedures 303 sys-symbols 304 Sequence Operators 304 nth 305 qsort 306 Control Features 306 apply 307 map 308 procedure? 309 Evaluation 309 eval 310 Literal Expressions 310 quote 311 quasiquote 312 Procedure 313 lambda 314 lambdaq 316 Comment 316 comment 317 Chapter 15 Event Definitions 318 $event-clear 319 $event-parse 320 $event->string 321 $make-event-map 322 $resolve-event-definition 324 change-pattern 325 copy 327 copy-strip 328 count-data-children 329 count-map-children 330 count-rep 331 data-map 332 display-event-data 334 display-event-dump 336 display-event-map 340 duplicate 343 duplicate-strip 344 file-check 345 file-lookup 346 get 347 list-lookup 348 path-node-has-data? 349 Monk Developer’s Reference 9 Contents not-verify 350 path? 351 path-defined? 352 path-defined-as-repeating? 353 path-event 354 path-event-symbol 355 path-nodeclear 356 path-nodedepth
Load more

Recommended publications
  • Shell Scripting with Bash
    Introduction to Shell Scripting with Bash Charles Jahnke Research Computing Services Information Services & Technology Topics for Today ● Introductions ● Basic Terminology ● How to get help ● Command-line vs. Scripting ● Variables ● Handling Arguments ● Standard I/O, Pipes, and Redirection ● Control Structures (loops and If statements) ● SCC Job Submission Example Research Computing Services Research Computing Services (RCS) A group within Information Services & Technology at Boston University provides computing, storage, and visualization resources and services to support research that has specialized or highly intensive computation, storage, bandwidth, or graphics requirements. Three Primary Services: ● Research Computation ● Research Visualization ● Research Consulting and Training Breadth of Research on the Shared Computing Cluster (SCC) Me ● Research Facilitator and Administrator ● Background in biomedical engineering, bioinformatics, and IT systems ● Offices on both CRC and BUMC ○ Most of our staff on the Charles River Campus, some dedicated to BUMC ● Contact: [email protected] You ● Who has experience programming? ● Using Linux? ● Using the Shared Computing Cluster (SCC)? Basic Terminology The Command-line The line on which commands are typed and passed to the shell. Username Hostname Current Directory [username@scc1 ~]$ Prompt Command Line (input) The Shell ● The interface between the user and the operating system ● Program that interprets and executes input ● Provides: ○ Built-in commands ○ Programming control structures ○ Environment
    [Show full text]
  • Powerview Command Reference
    PowerView Command Reference TRACE32 Online Help TRACE32 Directory TRACE32 Index TRACE32 Documents ...................................................................................................................... PowerView User Interface ............................................................................................................ PowerView Command Reference .............................................................................................1 History ...................................................................................................................................... 12 ABORT ...................................................................................................................................... 13 ABORT Abort driver program 13 AREA ........................................................................................................................................ 14 AREA Message windows 14 AREA.CLEAR Clear area 15 AREA.CLOSE Close output file 15 AREA.Create Create or modify message area 16 AREA.Delete Delete message area 17 AREA.List Display a detailed list off all message areas 18 AREA.OPEN Open output file 20 AREA.PIPE Redirect area to stdout 21 AREA.RESet Reset areas 21 AREA.SAVE Save AREA window contents to file 21 AREA.Select Select area 22 AREA.STDERR Redirect area to stderr 23 AREA.STDOUT Redirect area to stdout 23 AREA.view Display message area in AREA window 24 AutoSTOre ..............................................................................................................................
    [Show full text]
  • An Empirical Comparison of Widely Adopted Hash Functions in Digital Forensics: Does the Programming Language and Operating System Make a Difference?
    2015 Annual ADFSL Conference on Digital Forensics, Security and Law Proceedings May 19th, 11:45 AM An Empirical Comparison of Widely Adopted Hash Functions in Digital Forensics: Does the Programming Language and Operating System Make a Difference? Satyendra Gurjar Cyber Forensics Research and Education Group (UNHcFREG), Tagliatela College of Engineering, ECECS Department, University of New Haven, [email protected] Ibrahim Baggili Cyber Forensics Research and Education Group (UNHcFREG), Tagliatela College of Engineering, ECECS Department, University of New Haven Frank Breitinger CyberFollow F thisorensics and additional Research worksand Education at: https:/ Gr/commons.eroup (UNHcFREG),au.edu/adfsl Tagliatela College of Engineering, ECECS Depar Partment,t of the Univ Aviationersity ofSaf Newety and Hav Securityen Commons, Computer Law Commons, Defense and Security AliceStudies Fischer Commons , Forensic Science and Technology Commons, Information Security Commons, CyberNational For Securityensics Resear Law Commonsch and Education, OS and GrNetworksoup (UNHcFREG), Commons T, Otheragliatela Computer College Sciences of Engineering, Commons ECECS, and theDepar Socialtment, Contr Univol,ersity Law , ofCrime, New andHav enDe,viance AFischer@newha Commons ven.edu Scholarly Commons Citation Gurjar, Satyendra; Baggili, Ibrahim; Breitinger, Frank; and Fischer, Alice, "An Empirical Comparison of Widely Adopted Hash Functions in Digital Forensics: Does the Programming Language and Operating System Make a Difference?" (2015). Annual ADFSL Conference on Digital Forensics, Security and Law. 6. https://commons.erau.edu/adfsl/2015/tuesday/6 This Peer Reviewed Paper is brought to you for free and open access by the Conferences at Scholarly Commons. It has been accepted for inclusion in Annual ADFSL Conference on Digital Forensics, Security and Law by an (c)ADFSL authorized administrator of Scholarly Commons.
    [Show full text]
  • Lecture 17 the Shell and Shell Scripting Simple Shell Scripts
    Lecture 17 The Shell and Shell Scripting In this lecture • The UNIX shell • Simple Shell Scripts • Shell variables • File System commands, IO commands, IO redirection • Command Line Arguments • Evaluating Expr in Shell • Predicates, operators for testing strings, ints and files • If-then-else in Shell • The for, while and do loop in Shell • Writing Shell scripts • Exercises In this course, we need to be familiar with the "UNIX shell". We use it, whether bash, csh, tcsh, zsh, or other variants, to start and stop processes, control the terminal, and to otherwise interact with the system. Many of you have heard of, or made use of "shell scripting", that is the process of providing instructions to shell in a simple, interpreted programming language . To see what shell we are working on, first SSH into unix.andrew.cmu.edu and type echo $SHELL ---- to see the working shell in SSH We will be writing our shell scripts for this particular shell (csh). The shell scripting language does not fit the classic definition of a useful language. It does not have many of the features such as portability, facilities for resource intensive tasks such as recursion or hashing or sorting. It does not have data structures like arrays and hash tables. It does not have facilities for direct access to hardware or good security features. But in many other ways the language of the shell is very powerful -- it has functions, conditionals, loops. It does not support strong data typing -- it is completely untyped (everything is a string). But, the real power of shell program doesn't come from the language itself, but from the diverse library that it can call upon -- any program.
    [Show full text]
  • CMSC 426/626 - Computer Security Fall 2014
    Authentication and Passwords CMSC 426/626 - Computer Security Fall 2014 Outline • Types of authentication • Vulnerabilities of password authentication • Linux password authentication • Windows Password authentication • Cracking techniques Goals of Authentication • Identification - provide a claimed identity to the system. • Verification - establish validity of the provided identity. We’re not talking about message authentication, e.g. the use of digital signatures. Means of Authentication • Something you know, e.g. password • Something you have, e.g. USB dongle or Common Access Card (CAC) • Something you are, e.g. fingerprint • Something you do, e.g. hand writing Password-Based Authentication • User provides identity and password; system verifies that the password is correct for the given identity. • Identity determines access and privileges. • Identity can be used for Discretionary Access Control, e.g. to give another user access to a file. Password Hashing Password • System stores hash of the user password, not the plain text password. Hash Algorithm • Commonly used technique, e.g. UNIX password hashing. Password Hash Password Vulnerabilities Assume the authentication system stores hashed passwords. There are eight attack strategies. • Off-line Dictionary Attack - get hold of the password file, test a collection (dictionary) of possible passwords. ‣ Most systems protect the password file, but attackers sometimes get hold of one. • Specific Account Attack - given a specific user account, try popular passwords. ‣ Most systems use lockout mechanisms to make these attacks difficult. • Popular Password Attack - given a popular password, try it on multiple accounts. ‣ Harder to defend against - have to look for patterns in failed access attempts. • Targeted Password Guessing - use what you know about a user to intelligently guess their password.
    [Show full text]
  • Jellyfish Count -M 21 -S 100M -T 10 -C Reads.Fasta
    Jellysh 2 User Guide December 13, 2013 Contents 1 Getting started 2 1.1 Counting all k-mers . .2 1.1.1 Counting k-mers in sequencing reads . .3 1.1.2 Counting k-mers in a genome . .3 1.2 Counting high-frequency k-mers . .3 1.2.1 One pass method . .3 1.2.2 Two pass method . .4 2 FAQ 5 2.1 How to read compressed les (or other format)?newmacroname . .5 2.2 How to read multiple les at once? . .5 2.3 How to reduce the output size? . .6 3 Subcommands 7 3.1 histo .............................................7 3.2 dump .............................................7 3.3 query .............................................7 3.4 info ..............................................8 3.5 merge ............................................8 3.6 cite . .8 1 Chapter 1 Getting started 1.1 Counting all k-mers The basic command to count all k-mers is as follows: jellyfish count -m 21 -s 100M -t 10 -C reads.fasta This will count canonical (-C) 21-mers (-m 21), using a hash with 100 million elements (-s 100 M) and 10 threads (-t 10) in the sequences in the le reads.fasta. The output is written in the le 'mer_counts.jf' by default (change with -o switch). To compute the histogram of the k-mer occurrences, use the histo subcommand (see section 3.1): jellyfish histo mer_counts.jf To query the counts of a particular k-mer, use the query subcommand (see section 3.3): jellyfish query mer_counts.jf AACGTTG To output all the counts for all the k-mers in the le, use the dump subcommand (see section 3.2): jellyfish dump mer_counts.jf > mer_counts_dumps.fa To get some information on how, when and where this jellysh le was generated, use the info subcommand (see section 3.4): jellyfish info mer_counts.jf For more detail information, see the relevant sections in this document.
    [Show full text]
  • Husky: Towards a More Efficient and Expressive Distributed Computing Framework
    Husky: Towards a More Efficient and Expressive Distributed Computing Framework Fan Yang Jinfeng Li James Cheng Department of Computer Science and Engineering The Chinese University of Hong Kong ffyang,jfli,[email protected] ABSTRACT tends Spark, and Gelly [3] extends Flink, to expose to programmers Finding efficient, expressive and yet intuitive programming models fine-grained control over the access patterns on vertices and their for data-parallel computing system is an important and open prob- communication patterns. lem. Systems like Hadoop and Spark have been widely adopted Over-simplified functional or declarative programming interfaces for massive data processing, as coarse-grained primitives like map with only coarse-grained primitives also limit the flexibility in de- and reduce are succinct and easy to master. However, sometimes signing efficient distributed algorithms. For instance, there is re- over-simplified API hinders programmers from more fine-grained cent interest in machine learning algorithms that compute by fre- control and designing more efficient algorithms. Developers may quently and asynchronously accessing and mutating global states have to resort to sophisticated domain-specific languages (DSLs), (e.g., some entries in a large global key-value table) in a fine-grained or even low-level layers like MPI, but this raises development cost— manner [14, 19, 24, 30]. It is not clear how to program such algo- learning many mutually exclusive systems prolongs the develop- rithms using only synchronous and coarse-grained operators (e.g., ment schedule, and the use of low-level tools may result in bug- map, reduce, and join), and even with immutable data abstraction prone programming.
    [Show full text]
  • Daniel Lyons [email protected] Why?
    How to Hurt Your Friends with (loop) Daniel Lyons [email protected] Why? Fast Powerful Widely-used Like format you can probably do more with it than you realize. Even though you hate it, you may have to read it in someone else’s code. On my machine, 578 of 1068 library files contain at least one loop form (54.12%). It’s fast as hell. loop as List Comprehension Python: [ f(x) for x in L if p(x) ] Haskell: [ f(x) | x <- L, p(x) ] Erlang: [ f(X) || X <- L, p(X) ]. Loop: (loop for x in L when (p x) collect (f x)) Things You Can Do With loop Variable initialization and stepping Value accumulation Conditional and unconditional execution Pre- and post-loop operations Termination whenever and however you like This is taken from the list of kinds of loop clauses from CLtL Ch. 26 - variable initialization and stepping - value accumulation - termination conditions - unconditional execution - conditional execution - miscellaneous operations Initialization for/as with repeat for and as mean the same thing with is a single ‘let’ statement repeat runs the loop a specified number of times for Is Really Complicated for var from expr to expr for var in expr for var on expr Of course from can also be downfrom or upfrom, and to can also be downto, upto, below or above for var in expr: Loops over every item in the list Optionally by some stepping function for var on expr loops over the cdrs of a list, giving you each successive sublist Loops over each sublist of the list, e.g.
    [Show full text]
  • Linux Command Line: Aliases, Prompts and Scripting
    Linux Command Line: Aliases, Prompts and Scri... 1 Linux Command Line: Aliases, Prompts and Scripting By Steven Gordon on Wed, 23/07/2014 - 7:46am Here are a few notes on using the Bash shell that I have used as a demo to students. It covers man pages, aliases, shell prompts, paths and basics of shell scripting. For details, see the many free manuals of Bash shell scripting. 1. Man Pages Man pages are the reference manuals for commands. Reading the man pages is best when you know the command to use, but cannot remember the syntax or options. Simply type man cmd and then read the manual. E.g.: student@netlab01:~$ man ls If you don't know which command to use to perform some task, then there is a basic search feature called apropos which will do a keyword search through an index of man page names and short descriptions. You can run it using either the command apropos or using man -k. E.g.: student@netlab01:~$ man superuser No manual entry for superuser student@netlab01:~$ apropos superuser su (1) - change user ID or become superuser student@netlab01:~$ man -k "new user" newusers (8) - update and create new users in batch useradd (8) - create a new user or update default new user information Some common used commands are actually not standalone program, but commands built-in to the shell. For example, below demonstrates the creation of aliases using alias. But there is no man page for alias. Instead, alias is described as part of the bash shell man page.
    [Show full text]
  • The Xargs Package
    The xargs package Manuel Pégourié-Gonnard [email protected] v1.1 (2008/03/22) Contents 1 Introduction 1 2 Usage 1 3 Implementation 4 Important note for French users: a French version of the user documentation is included in the xargs-fr.pdf file. 1 Introduction A Defining commands with an optional argument is easy in LTEX2ε. There is, how- ever, two limitations: you can make only one argument optional and it must be the first one. The xargs package provide extended variants of \newcommand & friends, for which these limitations no longer hold: It is now easy to define commands with many (and freely placed) optional arguments, using a nice hkeyi=hvaluei syntax. For example, the following defines a command with two optional arguments. \newcommandx*\coord[3][1=1, 3=n]{(#2_{#1},\ldots,#2_{#3})} $\coord{x}$ (x1,...,xn) $\coord[0]{y}$ (y0,...,yn) $\coord{z}[m]$ (z1,...,zm) $\coord[0]{t}[m]$ (t0,...,tm) 2 Usage 2.1 Basics The xargs package defines an extended variant for every LATEX macro related to macro definition. xargs’s macro are named after their LATEX counterparts, just adding an x at end (see the list in the margin). Here is the complete list: \newcommandx \renewcommandx \newenvironmentx \renewenvironmentx \providecommandx \DeclareRobustCommandx \CheckCommandx 1 If you are not familiar with all of them, you can either just keep using the A commands you already know, or check Lamport’s book or the LTEX Companion (or any LATEX2ε manual) to learn the others. Since these commands all share the same syntax, I’ll always use \newcommandx in the following, but remember it works the same for all seven commands.
    [Show full text]
  • Table of Contents Local Transfers
    Table of Contents Local Transfers......................................................................................................1 Checking File Integrity.......................................................................................................1 Local File Transfer Commands...........................................................................................3 Shift Transfer Tool Overview..............................................................................................5 Local Transfers Checking File Integrity It is a good practice to confirm whether your files are complete and accurate before you transfer the files to or from NAS, and again after the transfer is complete. The easiest way to verify the integrity of file transfers is to use the NAS-developed Shift tool for the transfer, with the --verify option enabled. As part of the transfer, Shift will automatically checksum the data at both the source and destination to detect corruption. If corruption is detected, partial file transfers/checksums will be performed until the corruption is rectified. For example: pfe21% shiftc --verify $HOME/filename /nobackuppX/username lou% shiftc --verify /nobackuppX/username/filename $HOME your_localhost% sup shiftc --verify filename pfe: In addition to Shift, there are several algorithms and programs you can use to compute a checksum. If the results of the pre-transfer checksum match the results obtained after the transfer, you can be reasonably certain that the data in the transferred files is not corrupted. If
    [Show full text]
  • Unix-Like Access Permissions in Fully Decentralized File Systems
    Unix-like Access Permissions in Fully Decentralized File Systems Johanna Amann∗ Thomas Fuhrmann Technische Universitat¨ Munchen¨ Technische Universitat¨ Munchen¨ [email protected] [email protected] Current fully decentralized file systems just offer basic lic and a private part. World-readable files are stored access semantics. In most systems, there is no integrated in the public part of the group-directory in addition to access control. Every user who can access a file system the owner’s user-directory. Files that are only readable can read and sometimes even write all data. Only few by the group are stored in the private part of the group- systems offer better protection. However, they usually directory. Files that are only readable by the owning user involve algorithms that do not scale well, e. g. certifi- are only stored in the owner’s user-directory. The private cates that secure the file access rights. Often they require group directory is secured with a group encryption key. online third parties. To the best of our knowledge all sys- This encryption key is distributed to the group members tems also lack the standard Unix access permissions, that using the subset difference encryption scheme. When a users have become accustomed to. file-owner writes a file, the copy in her user-directory is In this poster, we show a decentralized, cryptograph- updated. When a group-member updates a file, the copy ically secure, scalable, and efficient way to introduce in the group-directory is updated. Both places have to be nearly the full spectrum of Unix file system access per- checked on access for the most recent version.
    [Show full text]