Using Data Sets

Total Page:16

File Type:pdf, Size:1020Kb

Using Data Sets Introducción al Sistemas Operativo z/OS Introducción a los Data Sets USING DATA SETS José Luis Calva Martínez Email: [email protected] [email protected] INTRODUCTION In working with the z/OS operating system, you must understand data sets, the files that contain programs and data. The characteristics of traditional z/OS data sets differ considerably from the file systems used in UNIX and PC systems. To make matters even more interesting, you can also create UNIX file systems on z/OS, with the common characteristics of UNIX systems. A data set is a collection of logically related data; it can be a source program, a library of programs, or a file of data records used by a processing program. DtDataset recordsarethe bibasicunit of ifinforma tion used bby a processing program. José Luis Calva 1 Introducción al Sistemas Operativo z/OS Introducción a los Data Sets WHAT IS A DATA SET? Nearly all work in the system involves data input or data output. In a mainframe system, the channel subsystem manages the use of I/O devices, such as disks, tapes, and printers, while z/OS associates the data for a given task with a device. z/OS manages data by means of data sets. The term data set refers to a file that contains one or more records. Any named group of records is called a data set. Data sets can hold information such as medical records or insurance records, to be used by a program running on the system. Data sets are also used to store information needed by applications or the operating system itself, such as source programs, macro libraries, or system variables or parameters. For data sets that contain readable text, you can print them or display them on a console (many data sets contain load modules or other binary data that is not really printable). Data sets can be cataloged, which permits the data set to be referred to by name without specifying where it is stored. WHAT IS A DATA SET? In simplest terms, a record is a fixed number of bytes containing data. Often, a record collects related information that we treat as a unit, such as one item in a database or personnel data about one member of a department. The term field refers to a specific portion of a record used for a particular category of data, such as an employee's name or department. The record is the basic unit of information used by a program running on z/OS. z/OS UNIX files are different from the typical z/OS data sets because they are byte-oriented rather than record-oriented. The records in a data set can be organized in various ways, depending on how we plan to access the information. If you write an application program that processes things like personnel data, for example, your program can define a record format for each person’s data. There are many different types of data sets in z/OS, and different methods for accessing them. We discuses three types of data sets: sequential, partitioned, and VSAM data sets. José Luis Calva 2 Introducción al Sistemas Operativo z/OS Introducción a los Data Sets DATA SETS TYPES Sequential data set, records are data items that are stored consecutively. To retrieve the tenth item in the data set, for example, the system must first pass the preceding nine items. Data items that must all be used in sequence, like the alphabetical list of names in a classroom roster, are best stored in a sequential data set. A partitioned data set or PDS consists of a directory and members. The directory holds the address of each member and thus makes it possible for programs or the operating system to access each member directly. Each member, however, consists of sequentially stored records. Partitioned data sets are often called A collection of logically related data records, such as a library of macros or a source program. Programs are stored as members of partitioned data sets. Generally, the operating system loads the members of a PDS into storage sequentially, but it can access members directly when selecting a program for execution. In a Virtual Storage Access Method (VSAM) key sequenced data set (KSDS), records are data items that are stored with control information (keys) so that the system can retrieve an item without searching all preceding items in the data set. VSAM KSDS data sets are ideal for data items that are used frequently and in an unpredictable order. Where are data sets stored? z/OS supports many different devices for data storage. Disks or tape are most frequently used for storing data sets on a long-term basis. Disk drives are known as direct access storage devices (DASDs) because, although some data sets on them might be stored sequentially, these devices can handle direct access. Tape drives are known as sequential access devices because data sets on tape must be accessed sequentially. The term DASD applies to disks or simulated equivalents of disks. All types of data sets can be stored on DASD (only sequential data sets can be stored on magnetic tape). You use DASD volumes for storing data and executable programs, including the operating system itself, and for temporary working storage. You can use one DASD volume for many different data sets, and reallocate or reuse space on the volume. To enable the system to locate a specific data set quickly, z/OS includes a data set known as the master catalog that permits access to any of the data sets in the computer system or to other catalogs of data sets. z/OS requires that the master catalog reside on a DASD that is always mounted on a drive that is online to the system. José Luis Calva 3 Introducción al Sistemas Operativo z/OS Introducción a los Data Sets What are access methods? An access method defines the technique that is used to store and retrieve data. Access methods have their own data set structures to organize data, system-provided programs (or macros) to define data sets, and utility programs to process data sets. Access methods are identified primarily by the data set organization. z/OS users, for example, use the basic sequential access method (BSAM) or queued sequential access method (QSAM) with sequential data sets. There are times when an access method identified with one organization can be used to process a data set organized in a different manner. For example, a sequential data set (not extended-format data set) created using BSAM can be processed by the basic direct access method (BDAM), and vice versa. Another example is UNIX files, which you can process using BSAM, QSAM, basic partitioned access method (BPAM), or virtual storage access method (VSAM). Commonly used access methods include the following: z QSAM Queued Sequential Access Method (heavily used) z BSAM Basic Sequential Access Method (for special cases) z BDAM Basic Direct Access Method (becoming obsolete) z BPAM Basic Partitioned Access Method (for libraries) z VSAM Virtual Sequential Access Method (used for more complex applications) How are DASD volumes used? DASD volumes are used for storing data and executable programs (including the operating system itself), and for temporary working storage. One DASD volume can be used for many different data sets, and space on it can be reallocated and reused. On a volume, the name of a data set must be unique. A data set can be located by device type, volume serial number, and data set name. This is unlike the file tree of a UNIX system. The basic z/OS file structure is not hierarchical. z/OS data sets have no equivalent to a path name. Although DASD volumes differ in physical appearance, capacity, and speed, they are similar in data recording, data checking, data format, and programming. The recording surface of each volume is divided into many concentric tracks. The number of tracks and their capacity vary with the device. Each device has an access mechanism that contains read/write heads to transfer data as the recording surface rotates past them. José Luis Calva 4 Introducción al Sistemas Operativo z/OS Introducción a los Data Sets DASD terminology for UNIX and PC users The disk and data set characteristics of mainframe hardware and software differ considerably from UNIX and PC systems, and carry their own specialized terminology. Throughout this text, the following terms are used to describe various aspects of storage management on z/OS: Direct Access Storage Device (DASD) is another name for a disk drive. A disk drive is also known as a disk volume, a disk pack, or a Head Disk Assembly (HDA). We use the term volume except when discussing physical characteristics of devices. A disk drive contains cylinders. Cylinders contain tracks. Tracks contain data records. Data blocks are the units of recording on disk. What are DASD labels? The operating system uses groups of labels to identify DASD volumes and the data sets they contain. Customer application programs generally do not use these labels directly. DASD volumes must use standard labels. Standard labels include a volume label, a data set label for each data set, and optional user labels. A volume label, stored at track 0 of cylinder 0, identifies each DASD volume. The z/OS system programmer or storage administrator uses the ICKDSF utility program to initialize each DASD volume before it is used on the system. ICKDSF generates the volume label and builds the volume table of contents (VTOC), a structure that contains the data set labels. The system programmer can also use ICKDSF to scan a volume to ensure that it is usable and to reformat all the tracks.
Recommended publications
  • IBM Mainframe Utility Programs ­ Wikipedia, the Free Encyclopedia IBM Mainframe Utility Programs from Wikipedia, the Free Encyclopedia
    9/11/2015 IBM mainframe utility programs ­ Wikipedia, the free encyclopedia IBM mainframe utility programs From Wikipedia, the free encyclopedia IBM mainframe utility programs are Utility software supplied with IBM mainframe operating systems such as MVS to carry out various tasks associated with datasets, etc. The following list describes utilities distributed with OS/360 and successors. No VSE or VM utilities are included. Contents 1 History/Common JCL 2 Dataset utilities 2.1 IDCAMS 2.2 IEBCOMPR 2.3 IEBCOPY 2.4 IEBDG 2.5 IEBEDIT 2.6 IEBGENER 2.7 IEBIMAGE 2.8 IEBISAM 2.9 IEBPTPCH 2.10 IEBUPDTE 3 Scheduler utilities 3.1 IEFBR14 4 System utilities 4.1 ICKDSF 4.2 IEHDASDR 4.3 IEHINITT 4.4 IEHLIST 4.5 IEHMOVE 4.6 IEHPROGM 5 Supporting programs 5.1 SORT 5.2 Compilers/Linker 5.3 DFSMS 6 References 7 See also 8 External links History/Common JCL Many of these utilities were designed by IBM users, through the group SHARE, and then modified or extended by IBM from versions originally written by a user. https://en.wikipedia.org/wiki/IBM_mainframe_utility_programs 1/14 9/11/2015 IBM mainframe utility programs ­ Wikipedia, the free encyclopedia These utilities are usually invoked via Job Control Language (JCL). They tend to use common JCL DD identifiers for their data sets: DDNAME Usual function input file for the 'commands' for the utility. Often set to DUMMY if the default action is SYSIN desired SYSUT1 input file SYSUT2 output file SYSUT3 work (spill) file for input (SYSUT1) (often not used) SYSUT4 work (spill) file for output (SYSUT2) (often not used) SYSPRINT output file for printed output from the utility SYSOUT output file for messages from the utility SYSUDUMP output file for a system 'dump' if the program fails Dataset utilities IDCAMS IDCAMS ("Access Method Services") generates and modifies Virtual Storage Access Method (VSAM) and Non­VSAM datasets.
    [Show full text]
  • Computer Labs for the Introduction to the New Mainframe: Z/OS Basics
    Computer Labs for the Introduction to the New Mainframe: z/OS Basics course Instructor Version The following labs are from the Introduction to the New Mainframe: z/OS Basics course/Redbook. These labs have been run and tested using the computer hub at Marist College in Poughkeepise, NY. You may need to adjust these labs to run on a computer system other than the one at Marist College. Chapter 2 Exercises (Section 2.16) ........................................................................................ 4 To display the CPU configuration ...................................................................................... 4 To display the page data set usage ..................................................................................... 4 To display information about the current Initial Program Load (IPL) ............................... 4 Instructor Notes .................................................................................................................. 4 Chapter 4 Exercises (Section 4.7) .......................................................................................... 5 4.7.1 Logging on to z/OS and entering TSO commands ................................................... 5 4.7.2 Navigating through the ISPF menu options .............................................................. 5 4.7.3 Using the ISPF editor ................................................................................................ 6 4.7.4 Using SDSF ..............................................................................................................
    [Show full text]
  • Systems OS/VS Virtual Storage Access Method (VSAM) Planning Guide
    GC26-3799-0 OS/VS Virtual Storage Access Method (VSAM) Systems Planning Guide First Edition (July 1972) This edition applies to release 2 of OS/VS1, to release 1 of OS/VS2, and to all subsequent releases until otherwise indicated in new editions or technical newsletters. Changes may be made to the information in this publication at any time; before using this publication in connection with the operation of IBM systems, consult the System/360 and System/370 Bibliography~ GA22-6822, and the latest System/360 and System/3 70 SRL Newsletter~ GN20-0360, for the editions that are applicable and current. Requests for copies of IBM publications should be made to your IBM representative or to the IBM branch office serving your locality. Forms for readers' comments are provided at the back of this publication. If the forms have been removed, comments may be addressed to IBM Corporation, Programming Publications, Department D78, Monterey and Cottle Roads, San Jose, California 95114. Comments become the property of IBM. © Copyright International Business Machines Corporation 1972 USING THIS PUBLICATION This publication is intended to enable prospective users of VSAM (virtual storage access method), an access method of OS/VS (operating system/virtual storage), to prepare for using VSAM. The intended audience is data-processing managers whose decisions will influence the use of VSAM, system and application programmers who will make detailed preparations, and others seeking an introduction to VSAM. This planning guide has six chapters: "Introducing VSAM" outlines how VSAM meets the requirements of an access method in today's data-processing environment.
    [Show full text]
  • DFSMS Basics: Data Set Fundamentals Get to Know Your Data Sets!
    DFSMS Basics: Data Set Fundamentals Get to Know Your Data Sets! Neal Bohling and Tom Reed DFSMS Defect Support @ IBM August 7, 2014 Session Number 16119 What'sWhat's youryour experienceexperience level?level? IBM 7094 1965 ~500KHz Background To fully understand z/OS Data Sets, let's look at how data is stored Tape Disk (Sequential) (Direct) DASD Structure ModernModern Devices Devices are are Modeled Modeled after after this this architecture: architecture: 1 1 Track Track = = 56664 56664 Bytes Bytes 1 1 Cylinder Cylinder = = 15 15 Tracks Tracks Data Sets • Volumes provide a stream of data. 1100100111000010110101001100100111100010111000111100100011000101110000101100010111100010111000111100001111010110110101001 1010111111001001110001111001001110101011100011111000011110101101101010011010111110000011101010111101000110010011100001011 0101001100100111100010111000111100100011000101110000101100010111100010111000111100001111010110110101001101011111100100111 0001111001001110101011100011111000011110101101101010011010111110000011101010111101000110010011100001011010100110010011110 0010111000111100100011000101110000101100010111100010111000111100001111010110110101001101011111100100111000111100100111010 1011100011111000011110101101101010011010111110000011101010111101000110010011100001011010100110010011110001011100011110010 0011000101110000101100010111100010111000111100001111010110110101001101011111100100111000111100100111010101110001111100001 1110101101101010011010111110000011101010111101000110010011100001011010100110010011110001011100011110010001100010111000010
    [Show full text]
  • Introduction to the New Mainframe: Z/OS Basics
    Front cover Introduction to the New Mainframe z/OS Basics Basic mainframe concepts, including usage and architecture z/OS fundamentals for students and beginners Mainframe hardware and peripheral devices Mike Ebbers John Kettner Wayne O’Brien Bill Ogden ibm.com/redbooks International Technical Support Organization Introduction to the New Mainframe: z/OS Basics March 2011 SG24-6366-02 Note: Before using this information and the product it supports, read the information in “Notices” on page xi. Third Edition (March 2011) © Copyright International Business Machines Corporation 2006, 2009, 2011. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xi Trademarks . xii Preface . xiii How this text is organized . xiv How each chapter is organized . xiv The team who wrote this book . xv Acknowledgements . xvi Now you can become a published author, too! . xix Comments welcome. xix Stay connected to IBM Redbooks . xix Summary of changes . xxi March 2011, Third Edition . xxi August 2009, Second Edition . xxi Part 1. Introduction to z/OS and the mainframe environment Chapter 1. Introduction to the new mainframe . 3 1.1 The new mainframe. 4 1.2 The System/360: A turning point in mainframe history . 4 1.3 An evolving architecture . 5 1.4 Mainframes in our midst . 8 1.5 What is a mainframe . 9 1.6 Who uses mainframe computers. 12 1.7 Factors contributing to mainframe use . 15 1.8 Typical mainframe workloads . 22 1.9 Roles in the mainframe world . 29 1.10 z/OS and other mainframe operating systems .
    [Show full text]
  • Partitioned Data Set Extended Usage Guide
    Front cover Partitioned Data Set Extended Usage Guide Learn the latest PDSE functions Use PDSEs for storing programs Compare PDS and PDSE capabilities Mary Lovelace Anthony Fletcher Dirk Gutschke Massimo Mastrorilli ibm.com/redbooks International Technical Support Organization Partitioned Data Set Extended Usage Guide May 2005 SG24-6106-01 Note: Before using this information and the product it supports, read the information in “Notices” on page xi. Second Edition (May 2005) This edition applies to Version1 Release 6 of z/OS (product number 5694-A01). © Copyright International Business Machines Corporation 2001, 2005. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xi Trademarks . xii Preface . xiii Become a published author . xiv Comments welcome. .xv Chapter 1. Release summary . 1 1.1 z/OS V1R3 DFSMS changes . 2 1.1.1 PDSE enhancements delivered with base code . 2 1.1.2 PDSE enhancement delivered with APAR OW53245. 2 1.2 z/OS V1R5 DFSMS changes . 4 1.2.1 PDSE enhancements delivered with base code . 4 1.3 z/OS V1R6 DFSMS changes . 5 1.3.1 PDSE RAS restartable address space enhancement. 5 Chapter 2. PDSE overview and concepts . 7 2.1 History of PDSEs . 8 2.1.1 Extended sharing . 8 2.1.2 Storing executable code in PDSEs . 8 2.1.3 Non-SMS PDSEs . 9 2.2 Partitioned data set review . 9 2.2.1 Partitioned data set organization . 9 2.2.2 Where to use partitioned organization . 10 2.2.3 Advantages of partitioned organization.
    [Show full text]
  • Paper SAS1715-2015 More Data, Less Chatter: Improving Performance on Z/OS Via IBM Zhpf Lewis King and Fred Forst, SAS Institute Inc., Cary, NC
    Paper SAS1715-2015 More Data, Less Chatter: Improving Performance on z/OS via IBM zHPF Lewis King and Fred Forst, SAS Institute Inc., Cary, NC ABSTRACT This paper describes how we reduced elapsed time for the third maintenance release for SAS® 9.4 by as much as 22% by using the High Performance FICON for IBM System z (zHPF) facility to perform I/O for SAS® files on IBM mainframe systems. The paper details the performance improvements, internal testing to quantify improvements, and the customer actions needed to enable zHPF on their system. The benefits of zHPF are discussed within the larger context of other techniques that a customer can use to accelerate processing of SAS files. INTRODUCTION To achieve optimum input/output (I/O) performance, the SAS product on the IBM mainframe operating system z/OS dynamically generates low-level I/O instructions (in the form of channel programs) to process SAS direct access bound libraries. For the types of I/O operations required by SAS processing, the channel programs generated by SAS provide a higher rate of throughput (amount of data per unit of elapsed time) than what is possible with standard IBM DFSMS access methods. In October 2008, IBM introduced High Performance FICON for System z (zHPF), which is a set of I/O architecture improvements that enable higher rates of I/O throughput (IBM 2015a). Over the next several years, zHPF capabilities were extended (IBM 2015a), and in October 2012, IBM announced functionality that enables programs like SAS to execute channel programs that take advantage of the zHPF feature (IBM 2015b).
    [Show full text]
  • MVS JCL User's Guide
    z/OS Version 2 Release 3 MVS JCL User's Guide IBM SA23-1386-30 Note Before using this information and the product it supports, read the information in “Notices” on page 261. This edition applies to Version 2 Release 3 of z/OS (5650-ZOS) and to all subsequent releases and modifications until otherwise indicated in new editions. Last updated: 2019-02-16 © Copyright International Business Machines Corporation 1988, 2017. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents List of Figures....................................................................................................... xi List of Tables.......................................................................................................xiii About this document............................................................................................xv Who should use this document..................................................................................................................xv Where to find more information................................................................................................................. xv How to send your comments to IBM.................................................................... xvii If you have a technical problem............................................................................................................... xvii Summary of changes........................................................................................
    [Show full text]
  • Fake Your Way Through MVS
    Fake Your Way through MVS (Chapters 22 – 26 of "The Operating Sys- tem Handbook: or, Fake Your Way Through Minis and Mainframes") Fake Your Way through MVS: (Chapters 22 – 26 of "The Op- erating System Handbook: or, Fake Your Way Through Minis and Mainframes") Table of Contents This Section, the Rest of the Book ..........................................................................ix I. MVS ...................................................................................................................1 Chapter 22 MVS: An Introduction ...................................................................3 22.1 Batch Jobs ......................................................................................4 22.2 Interacting with MVS ......................................................................5 22.2.1 TSO .....................................................................................5 22.2.2 ISPF ....................................................................................5 22.2.3 CICS ...................................................................................6 22.2.4 Other MVS Components .......................................................6 22.3 History ...........................................................................................6 Chapter 23 Getting Started with MVS ..............................................................9 23.1 Starting Up .....................................................................................9 23.1.1 VTAM .................................................................................9
    [Show full text]
  • Introduction to the New Mainframe Chapter 5: Working with Data Sets
    Introduction to the new mainframe Chapter 5: Working with data sets © Copyrig ht IBM Corp ., 2006. All rig hts reserved. Introduction to the new mainframe Chapter 5 objectives BbltBe able to: • Explain what a data set is • Describe data set naming conventions and record formats • List some access methods for managing data and programs • Explain what catalogs and VTOCs are used for • Create, delete, and modify data sets • Explain the differences between UNIX file systems and z/OS data sets • Describe the z/OS UNIX file systems’ use of data sets. © Copyright IBM Corp., 2006. All rights reserved. 2 Introduction to the new mainframe Key terms in this chapter • block s ize • member • catalog • PDS and PDSE • data set • record format or RECFM • high level qualifier or HLQ • system managed storage or • library SMS • logical record length or LRECL • virtual storage access method or VSAM • volume table of contents or VTOC © Copyright IBM Corp., 2006. All rights reserved. 3 Introduction to the new mainframe What is a data set? A data set is a collection of logically related data records stored on one disk storage volume or a set of volumes. AdA da ta se t can be: • a source program • a library of macros • a file of data records used by a processing program. You ca n p rint a data set or di spl ay i t on a termin al. Th e logical record is the basic unit of information used by a program running on z/OS. © Copyright IBM Corp., 2006. All rights reserved. 4 Introduction to the new mainframe How data is stored in a z/OS system • Data is store d on a direct access storage dev ice (DASD), magnetic tape volume, or optical media.
    [Show full text]
  • Systems OS/VS2 Access Method Services
    GC26-3841-0 File No. S370-30 Systems OS/VS2 Access Method Services Release 3 I !. ' First Edition (February 1975) This is the first edition of a new publication that applies to Release 3 of OS/VS2 and to all subsequent releases of that system unless otherwise indicated in new editions or technical newsletters. Another new publication, OS/VSJ Access Method Services, GC26-3840, contains corresponding OS/VS 1 information. OS/VS2 and OS/VS 1 information was previously intermingled in OS/VS Access Method Services, GC26-3836; this previous publication is now out of date for both OS/VS2 and OS/VS 1. (Information on the Mass Storage System is only for planning purposes until the availability of that product.) Significant system changes are summarized under "Summary of Amendments" following the list of figures. In additioll, miscellaneous editorial and technical changes have been made throughout the publication. Each technical change is marked by a vertical line to the left of the change. Information in this publication is subject to significant change. Any such changes will be published in new editions or technical newsletters. Before using the pUblication, consult the latest Virtual Storage Supplement (to IBM System/360 and System/370 Bibliography), GC20-0001, and the technical newsletters that amend the bibliography, to learn which editions and technical newsletters are applicable and current. Requests for copies of IBM publications should be made to the IBM branch office that serves you. Forms for readers' comments are provided at the back of the publication. If the forms have been removed, comments may be addressed to IBM Corporation, System Development Division, LDF Publishing-Department J04, 1501 California Avenue, Palo Alto, California 94304.
    [Show full text]
  • Z/OS Basic Skills Information Center: Reusable JCL Collection
    z/OS Basic Skills Information Center Reusable JCL collection z/OS Basic Skills Information Center Reusable JCL collection Note Before using this information and the product it supports, read the information in “Notices” on page 59. This edition applies to z/OS (product number 5694-A01). We appreciate your comments about this publication. Comment on specific errors or omissions, accuracy, organization, subject matter, or completeness of this book. The comments you send should pertain to only the information in this manual or product and the way in which the information is presented. For technical questions and information about products and prices, contact your IBM branch office, your IBM business partner, or your authorized remarketer. When you send comments to IBM, you grant IBM a nonexclusive right to use or distribute your comments in any way it believes appropriate without incurring any obligation to you. IBM or any other organizations will only use the personal information that you supply to contact you about the issues that you state on this form. Send your comments through this Web site: http://publib.boulder.ibm.com/infocenter/zoslnctr/v1r7/ index.jsp?topic=/com.ibm.zcontact.doc/webqs.html © Copyright International Business Machines Corporation 2007, 2008. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Introducing the reusable JCL collection v JCL EXEC statements: How z/OS finds the program or procedure . .38 JCL statements: What does the DD statement do? .40 Chapter 1. Preparing to use JCL JCL DD statements: Advantages of using samples in this collection .
    [Show full text]