Getting Started on RCAC Resources

Total Page:16

File Type:pdf, Size:1020Kb

Getting Started on RCAC Resources SoftwareSoftware ProductivityProductivity ToolsTools Purdue School on HPC Sept. 4-5, 2008 Dave Seaman ([email protected]) Rosen Center for Advanced Computing AA SelectionSelection ofof ToolsTools TarTar MakeMake PBSPBS VersionVersion controlcontrol systemssystems •• CVSCVS •• subversionsubversion TarTar SimpleSimple ArchivesArchives CompressedCompressed ArchivesArchives ((gzipgzip)) CompressedCompressed ArchivesArchives ((bzip2bzip2)) SimpleSimple ArchivesArchives CreatingCreating anan ArchiveArchive ExractingExracting fromfrom anan ArchiveArchive LookingLooking beforebefore YouYou LeapLeap CreatingCreating anan ArchiveArchive tartar cfcf myarchive.tarmyarchive.tar filesfiles UseUse cc optionoption toto createcreate anan archivearchive UseUse ff optionoption toto specifyspecify aa diskdisk filefile (default(default isis tape)tape) ExtractingExtracting fromfrom anan ArchiveArchive tartar xfxf myarchive.tarmyarchive.tar [files[files……]] UseUse xx optionoption toto extractextract files.files. DefaultDefault isis toto extractextract allall filesfiles inin archive.archive. LookingLooking beforebefore YouYou LeapLeap ManyMany archivesarchives willwill extractextract intointo aa subdirectory,subdirectory, butbut somesome writewrite filesfiles inin currentcurrent directory.directory. ToTo bebe safe,safe, extractextract intointo anan emptyempty directory.directory. UseUse tt optionoption toto seesee what'swhat's there:there: tartar tftf myarchive.tarmyarchive.tar CompressedCompressed ArchivesArchives ((gzipgzip)) WeWe maymay useuse gzipgzip toto compresscompress anan archive:archive: tartar cfcf mystuff.tarmystuff.tar mystuffmystuff gzipgzip mystuff.tarmystuff.tar AA shortcutshortcut isis availableavailable whenwhen usingusing GNUGNU tar:tar: tartar zcfzcf mystuff.tar.gzmystuff.tar.gz mystuffmystuff UncompressingUncompressing withwith gunzipgunzip AA compressedcompressed archivearchive namename maymay endend inin ..tar.gztar.gz,, .tar.Z,.tar.Z, oror ..tgztgz.. WeWe maymay extractextract filesfiles byby usingusing aa twotwo--stepstep process:process: gunzipgunzip mystuff.tar.gzmystuff.tar.gz tartar xfxf mystuff.tarmystuff.tar UncompressingUncompressing ShortcutsShortcuts WeWe maymay useuse zcatzcat toto unzipunzip andand pipepipe thethe resultresult intointo tar:tar: zcatzcat mystuff.tar.gzmystuff.tar.gz || tartar xfxf -- GNUGNU tartar hashas thethe zz optionoption forfor zip/unzip:zip/unzip: tartar zxfzxf mystuff.tar.gzmystuff.tar.gz Bzip2Bzip2 CompressionCompression Bzip2Bzip2 isis usedused muchmuch likelike gzipgzip,, butbut tendstends toto havehave betterbetter compressioncompression ratiosratios atat thethe costcost ofof slightlyslightly moremore time.time. bzip2 mystuff.tar bunzip2 mystuff.tar.bz2 bzcat mystuff.tar.bz2 | tar xf - GNUGNU tartar andand bzip2bzip2 GNUGNU tartar usesuses thethe jj optionoption toto invokeinvoke bzip2/bunzip2:bzip2/bunzip2: tar jcf mystuff.tar.bz2 mystuff tar jxf mystuff.tar.bz2 MakeMake AutomatesAutomates maintainingmaintaining filesfiles thatthat dependdepend onon otherother files.files. MayMay bebe usedused forfor programs,programs, documents,documents, oror arbitraryarbitrary developmentdevelopment projects.projects. InstructionsInstructions containedcontained inin MakefileMakefile controlcontrol stepssteps neededneeded toto keepkeep filesfiles upup toto date.date. SimpleSimple MakefileMakefile ## variablevariable definitionsdefinitions PROGPROG == graphgraph SRCSRC == main.cmain.c graph.cgraph.c OBJOBJ == main.omain.o graph.ograph.o CCCC == iccicc CFLAGSCFLAGS == --O2O2 LOADLIBESLOADLIBES == --lmlm SimpleSimple MakefileMakefile (cont.)(cont.) all:all: $(PROG)$(PROG) $(PROG):$(PROG): $(OBJ)$(OBJ) $(LINK.c)$(LINK.c) --oo $@$@ $(OBJ)$(OBJ) $(LOADLIBES)$(LOADLIBES) ## additionaladditional dependencydependency rulerule main.omain.o graph.o:graph.o: graph.hgraph.h RulesRules target:target: prereq1prereq1 prereq2prereq2 …… command1command1 command2command2 [[……]] EachEach commandcommand mustmust bebe precededpreceded byby aa tab.tab. InvokingInvoking makemake make [-f makefile] [target] [var=defs]… DefaultDefault makefilemakefile namesnames (in(in order):order): •• GNUmakefileGNUmakefile •• makefilemakefile •• MakefileMakefile DefaultDefault targettarget isis firstfirst oneone inin makefilemakefile.. VariableVariable definitionsdefinitions onon commandcommand lineline overrideoverride valuesvalues givengiven inin makefilemakefile.. SimpleSimple MakefileMakefile ## variablevariable definitionsdefinitions PROGPROG == graphgraph SRCSRC == main.cmain.c graph.cgraph.c OBJOBJ == main.omain.o graph.ograph.o CCCC == iccicc CFLAGSCFLAGS == --O2O2 LOADLIBESLOADLIBES == --lmlm SimpleSimple RuleRule OurOur simplesimple makefilemakefile containscontains asas itsits firstfirst rule:rule: all:all: $(PROG)$(PROG) ThisThis meansmeans make isis equivalentequivalent toto make all. ThereThere isis oneone prerequisite:prerequisite: thethe targettarget allall dependsdepends onon $(PROG),$(PROG), whichwhich involvesinvolves aa variablevariable substitution:substitution: PROG = graph VariableVariable SubstitutionSubstitution VariableVariable namename isis precededpreceded byby $$ andand isis enclosedenclosed inin parentheses:parentheses: $(PROG) ParenthesesParentheses maymay bebe omittedomitted onlyonly ifif thethe namename isis aa singlesingle character.character. SomeSome havehave standardstandard meanings,meanings, suchsuch asas $@ forfor thethe targettarget currentlycurrently beingbeing updated.updated. BracesBraces maymay bebe usedused insteadinstead ofof parentheses:parentheses: ${PROG} DefaultDefault RulesRules TheThe MakefileMakefile sayssays $(PROG)$(PROG) dependsdepends onon $(OBJ)$(OBJ) andand givesgives aa commandcommand toto useuse forfor creatingcreating $(PROG):$(PROG): $(PROG): $(OBJ) $(LINK.c) -o $@ $(OBJ) $(LOADLIBES) However,However, nono rulesrules areare statedstated forfor producingproducing thethe $(OBJ)$(OBJ) files.files. TheThe DefaultDefault RulesRules SinceSince nono commandscommands werewere foundfound forfor makingmaking thethe objectobject files,files, makemake usedused thethe defaultdefault rule:rule: %.o:%.o: %.c%.c ## builtbuilt--inin commandscommands toto makemake aa .o.o filefile $(COMPILE.c)$(COMPILE.c) $(OUTPUT_OPTION)$(OUTPUT_OPTION) $<$< TheThe rulerule beginningbeginning withwith %.o: %.c isis anan exampleexample ofof aa patternpattern rulerule.. DefaultDefault CompilationCompilation RuleRule $(COMPILE.c)$(COMPILE.c) isis predefinedpredefined byby makemake:: COMPILE.c = $(CC) $(CFLAGS) $(CPPFLAGS) \ $(TARGET_ARCH) -c YouYou maymay definedefine thethe variablesvariables (CC,(CC, CFLAGS,CFLAGS, ……)) asas neededneeded inin orderorder toto customizecustomize thethe command.command. SomeSome StandardStandard VariablesVariables $(COMPILE.c) Command for compiling C programs $(LINK.c) Command for linking C programs $< First prerequisite $@ Target being updated $(CC) C compiler $(CFLAGS) Flags for C compiler $(CPPFLAGS) Flags for C preprocessor $(CXX) C++ compiler CommandsCommands ProducedProduced RunningRunning makemake withwith thesethese rulesrules maymay produceproduce severalseveral commands:commands: iccicc --O2O2 --cc --oo main.omain.o main.cmain.c iccicc --O2O2 --cc --oo graph.ograph.o graph.cgraph.c iccicc --O2O2 --oo graphgraph main.omain.o graph.ograph.o --lmlm OnlyOnly thethe necessarynecessary stepssteps areare actuallyactually performed,performed, dependingdepending onon whichwhich filesfiles areare olderolder thanthan theirtheir prerequisites.prerequisites. SpecifyingSpecifying DependenciesDependencies TheThe filesfiles main.cmain.c andand graph.cgraph.c bothboth #include#include "graph.h""graph.h".. IfIf wewe makemake changeschanges inin graph.hgraph.h,, thenthen bothboth main.omain.o andand graph.ograph.o needneed toto bebe updatedupdated (recompiled).(recompiled). NoNo commandscommands areare neededneeded here.here. WeWe onlyonly needneed thethe dependencydependency toto forceforce recompilationrecompilation usingusing thethe builtbuilt--inin rule.rule. OOtherther UseUsefulful FlagsFlags withwith makemake --nn DisplayDisplay thethe commandscommands thatthat willwill bebe generated,generated, butbut don'tdon't execute.execute. --vv ShowShow verboseverbose output.output. --pp ShowShow completecomplete databasedatabase ofof rules,rules, includingincluding builtbuilt--inin rules.rules. ForFor MoreMore InformationInformation http://www.gnu.org/software/make/manual/make.htmlhttp://www.gnu.org/software/make/manual/make.html PortablePortable BatchBatch SSystemystem (PBS)(PBS) SubmitsSubmits jobsjobs toto runrun onon aa cluster.cluster. SchedulesSchedules jobsjobs toto runrun whenwhen resourcesresources becomebecome available.available. ManagesManages runningrunning ofof jobsjobs andand returnsreturns outputoutput toto user.user. AllowsAllows interactiveinteractive execution.execution. UsefulUseful PBSPBS CommandsCommands qsubqsub SubmitSubmit PBSPBS jobjob qdelqdel DeleteDelete PBSPBS jobjob qstatqstat DisplayDisplay statusstatus ofof PBSPBS jobs,jobs, queues,queues, oror serversservers pbsnodespbsnodes QueryQuery PBSPBS hosthost statusstatus TheThe qsubqsub CommandCommand ToTo submitsubmit thethe scriptscript myscriptmyscript asas aa batchbatch job,job, use:use: qsub [options] myscript OptionsOptions maymay bebe embeddedembedded inin aa scriptscript filefile oror specifiedspecified onon thethe commandcommand line.line. ToTo submitsubmit anan interactiveinteractive job,job, use:use: qsub -I [options] UseUse man qsub toto
Recommended publications
  • Contrasting the Performance of Compression Algorithms on Genomic Data
    Contrasting the Performance of Compression Algorithms on Genomic Data Cornel Constantinescu, IBM Research Almaden Outline of the Talk: • Introduction / Motivation • Data used in experiments • General purpose compressors comparison • Simple Improvements • Special purpose compression • Transparent compression – working on compressed data (prototype) • Parallelism / Multithreading • Conclusion Introduction / Motivation • Despite the large number of research papers and compression algorithms proposed for compressing genomic data generated by sequencing machines, by far the most commonly used compression algorithm in the industry for FASTQ data is gzip. • The main drawbacks of the proposed alternative special-purpose compression algorithms are: • slow speed of either compression or decompression or both, and also their • brittleness by making various limiting assumptions about the input FASTQ format (for example, the structure of the headers or fixed lengths of the records [1]) in order to further improve their specialized compression. 1. Ibrahim Numanagic, James K Bonfield, Faraz Hach, Jan Voges, Jorn Ostermann, Claudio Alberti, Marco Mattavelli, and S Cenk Sahinalp. Comparison of high-throughput sequencing data compression tools. Nature Methods, 13(12):1005–1008, October 2016. Fast and Efficient Compression of Next Generation Sequencing Data 2 2 General Purpose Compression of Genomic Data As stated earlier, gzip/zlib compression is the method of choice by the industry for FASTQ genomic data. FASTQ genomic data is a text-based format (ASCII readable text) for storing a biological sequence and the corresponding quality scores. Each sequence letter and quality score is encoded with a single ASCII character. FASTQ data is structured in four fields per record (a “read”). The first field is the SEQUENCE ID or the header of the read.
    [Show full text]
  • Pack, Encrypt, Authenticate Document Revision: 2021 05 02
    PEA Pack, Encrypt, Authenticate Document revision: 2021 05 02 Author: Giorgio Tani Translation: Giorgio Tani This document refers to: PEA file format specification version 1 revision 3 (1.3); PEA file format specification version 2.0; PEA 1.01 executable implementation; Present documentation is released under GNU GFDL License. PEA executable implementation is released under GNU LGPL License; please note that all units provided by the Author are released under LGPL, while Wolfgang Ehrhardt’s crypto library units used in PEA are released under zlib/libpng License. PEA file format and PCOMPRESS specifications are hereby released under PUBLIC DOMAIN: the Author neither has, nor is aware of, any patents or pending patents relevant to this technology and do not intend to apply for any patents covering it. As far as the Author knows, PEA file format in all of it’s parts is free and unencumbered for all uses. Pea is on PeaZip project official site: https://peazip.github.io , https://peazip.org , and https://peazip.sourceforge.io For more information about the licenses: GNU GFDL License, see http://www.gnu.org/licenses/fdl.txt GNU LGPL License, see http://www.gnu.org/licenses/lgpl.txt 1 Content: Section 1: PEA file format ..3 Description ..3 PEA 1.3 file format details ..5 Differences between 1.3 and older revisions ..5 PEA 2.0 file format details ..7 PEA file format’s and implementation’s limitations ..8 PCOMPRESS compression scheme ..9 Algorithms used in PEA format ..9 PEA security model .10 Cryptanalysis of PEA format .12 Data recovery from
    [Show full text]
  • Improved Neural Network Based General-Purpose Lossless Compression Mohit Goyal, Kedar Tatwawadi, Shubham Chandak, Idoia Ochoa
    JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2015 1 DZip: improved neural network based general-purpose lossless compression Mohit Goyal, Kedar Tatwawadi, Shubham Chandak, Idoia Ochoa Abstract—We consider lossless compression based on statistical [4], [5] and generative modeling [6]). Neural network based data modeling followed by prediction-based encoding, where an models can typically learn highly complex patterns in the data accurate statistical model for the input data leads to substantial much better than traditional finite context and Markov models, improvements in compression. We propose DZip, a general- purpose compressor for sequential data that exploits the well- leading to significantly lower prediction error (measured as known modeling capabilities of neural networks (NNs) for pre- log-loss or perplexity [4]). This has led to the development of diction, followed by arithmetic coding. DZip uses a novel hybrid several compressors using neural networks as predictors [7]– architecture based on adaptive and semi-adaptive training. Unlike [9], including the recently proposed LSTM-Compress [10], most NN based compressors, DZip does not require additional NNCP [11] and DecMac [12]. Most of the previous works, training data and is not restricted to specific data types. The proposed compressor outperforms general-purpose compressors however, have been tailored for compression of certain data such as Gzip (29% size reduction on average) and 7zip (12% size types (e.g., text [12] [13] or images [14], [15]), where the reduction on average) on a variety of real datasets, achieves near- prediction model is trained in a supervised framework on optimal compression on synthetic datasets, and performs close to separate training data or the model architecture is tuned for specialized compressors for large sequence lengths, without any the specific data type.
    [Show full text]
  • User Commands GZIP ( 1 ) Gzip, Gunzip, Gzcat – Compress Or Expand Files Gzip [ –Acdfhllnnrtvv19 ] [–S Suffix] [ Name ... ]
    User Commands GZIP ( 1 ) NAME gzip, gunzip, gzcat – compress or expand files SYNOPSIS gzip [–acdfhlLnNrtvV19 ] [– S suffix] [ name ... ] gunzip [–acfhlLnNrtvV ] [– S suffix] [ name ... ] gzcat [–fhLV ] [ name ... ] DESCRIPTION Gzip reduces the size of the named files using Lempel-Ziv coding (LZ77). Whenever possible, each file is replaced by one with the extension .gz, while keeping the same ownership modes, access and modification times. (The default extension is – gz for VMS, z for MSDOS, OS/2 FAT, Windows NT FAT and Atari.) If no files are specified, or if a file name is "-", the standard input is compressed to the standard output. Gzip will only attempt to compress regular files. In particular, it will ignore symbolic links. If the compressed file name is too long for its file system, gzip truncates it. Gzip attempts to truncate only the parts of the file name longer than 3 characters. (A part is delimited by dots.) If the name con- sists of small parts only, the longest parts are truncated. For example, if file names are limited to 14 characters, gzip.msdos.exe is compressed to gzi.msd.exe.gz. Names are not truncated on systems which do not have a limit on file name length. By default, gzip keeps the original file name and timestamp in the compressed file. These are used when decompressing the file with the – N option. This is useful when the compressed file name was truncated or when the time stamp was not preserved after a file transfer. Compressed files can be restored to their original form using gzip -d or gunzip or gzcat.
    [Show full text]
  • Software to Extract Cab Files
    Software to extract cab files click here to download You can use WinZip to extract CAB files by following the steps listed below. file extension associated with WinZip program, just double-click on the file. PeaZip offers read-only support (open and extract cab files) for Microsoft Cabinet file format, providing a free alternative utility to open (list content) and www.doorway.ru packages, or disassemble single files from the container, under Windows and Linux operating systems. Moreover, the OS can create, extract, or rebuild cab files. This means you do not require any additional third-party software for this task. All CAB. For a number of years, Microsoft has www.doorway.ru files to compress software that was distributed on disks. Originally, these files were used to minimize the number . The InstallShield installer program makes files with the CAB However, you can also open or extract CAB files with a file decompression tool. Open, browse, extract, or view Microsoft CAB files with Altap Salamander File Manager. High quality software with emphasis on error states. Affordable cost: . Microsoft uses cab files to package software programs. You can view the contents of a cab file by unzipping it and extracting its contents to a. Hi, I need some help www.doorway.ru files. I have to extract a patch for one game, so i used universal extractor for to extract www.doorway.ru Now I have to. cab Extension - List of programs that can www.doorway.ru files. www.doorway.ru, Inventoria Stock Manager, NCH Software, Extract with Express Zip, Low.
    [Show full text]
  • The Ark Handbook
    The Ark Handbook Matt Johnston Henrique Pinto Ragnar Thomsen The Ark Handbook 2 Contents 1 Introduction 5 2 Using Ark 6 2.1 Opening Archives . .6 2.1.1 Archive Operations . .6 2.1.2 Archive Comments . .6 2.2 Working with Files . .7 2.2.1 Editing Files . .7 2.3 Extracting Files . .7 2.3.1 The Extract dialog . .8 2.4 Creating Archives and Adding Files . .8 2.4.1 Compression . .9 2.4.2 Password Protection . .9 2.4.3 Multi-volume Archive . 10 3 Using Ark in the Filemanager 11 4 Advanced Batch Mode 12 5 Credits and License 13 Abstract Ark is an archive manager by KDE. The Ark Handbook Chapter 1 Introduction Ark is a program for viewing, extracting, creating and modifying archives. Ark can handle vari- ous archive formats such as tar, gzip, bzip2, zip, rar, 7zip, xz, rpm, cab, deb, xar and AppImage (support for certain archive formats depends on the appropriate command-line programs being installed). In order to successfully use Ark, you need KDE Frameworks 5. The library libarchive version 3.1 or above is needed to handle most archive types, including tar, compressed tar, rpm, deb and cab archives. To handle other file formats, you need the appropriate command line programs, such as zipinfo, zip, unzip, rar, unrar, 7z, lsar, unar and lrzip. 5 The Ark Handbook Chapter 2 Using Ark 2.1 Opening Archives To open an archive in Ark, choose Open... (Ctrl+O) from the Archive menu. You can also open archive files by dragging and dropping from Dolphin.
    [Show full text]
  • File Management Tools
    File Management Tools ● gzip and gunzip ● tar ● find ● df and du ● od ● nm and strip ● sftp and scp Gzip and Gunzip ● The gzip utility compresses a specified list of files. After compressing each specified file, it renames it to have a “.gz” extension. ● General form. gzip [filename]* ● The gunzip utility uncompresses a specified list of files that had been previously compressed with gzip. ● General form. gunzip [filename]* Tar (38.2) ● Tar is a utility for creating and extracting archives. It was originally setup for archives on tape, but it now is mostly used for archives on disk. It is very useful for sending a set of files to someone over the network. Tar is also useful for making backups. ● General form. tar options filenames Commonly Used Tar Options c # insert files into a tar file f # use the name of the tar file that is specified v # output the name of each file as it is inserted into or # extracted from a tar file x # extract the files from a tar file Creating an Archive with Tar ● Below is the typical tar command used to create an archive from a set of files. Note that each specified filename can also be a directory. Tar will insert all files in that directory and any subdirectories. tar cvf tarfilename filenames ● Examples: tar cvf proj.tar proj # insert proj directory # files into proj.tar tar cvf code.tar *.c *.h # insert *.c and *.h files # into code.tar Extracting Files from a Tar Archive ● Below is the typical tar command used to extract the files from a tar archive.
    [Show full text]
  • K.2 Firmware Updater Technical Note
    K.2 Series Active Loudspeakers Technical Notes K.2 Firmware Updater—Mac OS Installation Purpose: This Technical Note is for users who get an error message from the Mac Operating System (Mac OS) when attempting to install the K2Updater-2.0.1-osx-installer app. The error message recommends deletion of the app. If the K2Updater-2.0.1-osx-installer app was successfully downloaded, extracted, and installed, this document is unnecessary. If the error message appears when you double-click on the K2Updater-2.0.1-osx-installer app, use the following procedure to work around it and successfully install the K.2 Firmware updater. Software required: • Internet browser (Safari, Firefox, Chrome, etc.) • K2Updater-2.0.1-osx-installer.tar.gz MacOS utilities required: • Archive Utility • Terminal Utility Using Terminal to enable the K.2 Update Installer NOTE: If you have not done so already, download and extract the fileK2Updater-2.0.1-osx-installer.tar.gz from the K.2 firmware update page at www.qsc.com. The Terminal app in the Mac OS is similar to the Command Prompt (CMD) app in Windows. By accessing the OS shell, it allows changes at the root level that allow the K2Updater-2.0.1-osx-installer.app to run. Revision A—8 April 2020 1 K.2 Series Active Loudspeakers Technical Notes K.2 Firmware Updater—Mac OS Installation 1. Open the folder Applcations/Go/Utilities/Terminal. Double-click Terminal to launch. 2. In the Terminal window at the prompt, type xattr<space>-cr<space> but do not press Return yet.
    [Show full text]
  • UNIX (Solaris/Linux) Quick Reference Card Logging in Directory Commands at the Login: Prompt, Enter Your Username
    UNIX (Solaris/Linux) QUICK REFERENCE CARD Logging In Directory Commands At the Login: prompt, enter your username. At the Password: prompt, enter ls Lists files in current directory your system password. Linux is case-sensitive, so enter upper and lower case ls -l Long listing of files letters as required for your username, password and commands. ls -a List all files, including hidden files ls -lat Long listing of all files sorted by last Exiting or Logging Out modification time. ls wcp List all files matching the wildcard Enter logout and press <Enter> or type <Ctrl>-D. pattern Changing your Password ls dn List files in the directory dn tree List files in tree format Type passwd at the command prompt. Type in your old password, then your new cd dn Change current directory to dn password, then re-enter your new password for verification. If the new password cd pub Changes to subdirectory “pub” is verified, your password will be changed. Many systems age passwords; this cd .. Changes to next higher level directory forces users to change their passwords at predetermined intervals. (previous directory) cd / Changes to the root directory Changing your MS Network Password cd Changes to the users home directory cd /usr/xx Changes to the subdirectory “xx” in the Some servers maintain a second password exclusively for use with Microsoft windows directory “usr” networking, allowing you to mount your home directory as a Network Drive. mkdir dn Makes a new directory named dn Type smbpasswd at the command prompt. Type in your old SMB passwword, rmdir dn Removes the directory dn (the then your new password, then re-enter your new password for verification.
    [Show full text]
  • Z/VM Version 7 Release 2
    z/VM Version 7 Release 2 OpenExtensions User's Guide IBM SC24-6299-01 Note: Before you use this information and the product it supports, read the information in “Notices” on page 201. This edition applies to Version 7.2 of IBM z/VM (product number 5741-A09) and to all subsequent releases and modifications until otherwise indicated in new editions. Last updated: 2020-09-08 © Copyright International Business Machines Corporation 1993, 2020. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures................................................................................................................. xi Tables................................................................................................................ xiii About this Document........................................................................................... xv Intended Audience..................................................................................................................................... xv Conventions Used in This Document......................................................................................................... xv Escape Character Notation................................................................................................................... xv Case-Sensitivity.....................................................................................................................................xv Typography............................................................................................................................................xv
    [Show full text]
  • Arrow: Integration to 'Apache' 'Arrow'
    Package ‘arrow’ September 5, 2021 Title Integration to 'Apache' 'Arrow' Version 5.0.0.2 Description 'Apache' 'Arrow' <https://arrow.apache.org/> is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. This package provides an interface to the 'Arrow C++' library. Depends R (>= 3.3) License Apache License (>= 2.0) URL https://github.com/apache/arrow/, https://arrow.apache.org/docs/r/ BugReports https://issues.apache.org/jira/projects/ARROW/issues Encoding UTF-8 Language en-US SystemRequirements C++11; for AWS S3 support on Linux, libcurl and openssl (optional) Biarch true Imports assertthat, bit64 (>= 0.9-7), methods, purrr, R6, rlang, stats, tidyselect, utils, vctrs RoxygenNote 7.1.1.9001 VignetteBuilder knitr Suggests decor, distro, dplyr, hms, knitr, lubridate, pkgload, reticulate, rmarkdown, stringi, stringr, testthat, tibble, withr Collate 'arrowExports.R' 'enums.R' 'arrow-package.R' 'type.R' 'array-data.R' 'arrow-datum.R' 'array.R' 'arrow-tabular.R' 'buffer.R' 'chunked-array.R' 'io.R' 'compression.R' 'scalar.R' 'compute.R' 'config.R' 'csv.R' 'dataset.R' 'dataset-factory.R' 'dataset-format.R' 'dataset-partition.R' 'dataset-scan.R' 'dataset-write.R' 'deprecated.R' 'dictionary.R' 'dplyr-arrange.R' 'dplyr-collect.R' 'dplyr-eval.R' 'dplyr-filter.R' 'expression.R' 'dplyr-functions.R' 1 2 R topics documented: 'dplyr-group-by.R' 'dplyr-mutate.R' 'dplyr-select.R' 'dplyr-summarize.R'
    [Show full text]
  • Gzip, Bzip2 and Tar EXPERT PACKING
    LINUXUSER Command Line: gzip, bzip2, tar gzip, bzip2 and tar EXPERT PACKING A short command is all it takes to pack your data or extract it from an archive. BY HEIKE JURZIK rchiving provides many bene- fits: packed and compressed Afiles occupy less space on your disk and require less bandwidth on the Internet. Linux has both GUI-based pro- grams, such as File Roller or Ark, and www.sxc.hu command-line tools for creating and un- packing various archive types. This arti- cle examines some shell tools for ar- chiving files and demonstrates the kind of expert packing that clever combina- tained by the packing process. If you A gzip file can be unpacked using either tions of Linux commands offer the com- prefer to use a different extension, you gunzip or gzip -d. If the tool discovers a mand line user. can set the -S (suffix) flag to specify your file of the same name in the working di- own instead. For example, the command rectory, it prompts you to make sure that Nicely Packed with “gzip” you know you are overwriting this file: The gzip (GNU Zip) program is the de- gzip -S .z image.bmp fault packer on Linux. Gzip compresses $ gunzip screenie.jpg.gz simple files, but it does not create com- creates a compressed file titled image. gunzip: screenie.jpg U plete directory archives. In its simplest bmp.z. form, the gzip command looks like this: The size of the compressed file de- Listing 1: Compression pends on the distribution of identical Compared gzip file strings in the original file.
    [Show full text]