DOCSLIB.ORG

CA Workload Automation CRON Scheduler Challenges and Business Impact

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
CA Workload Automation CRON Scheduler Challenges and Business Impact Reference Guide CA Workload Automation CRON Scheduler Challenges and Business Impact Key Capabilities and What You Get Why This is Potential Impact to Your Business What to Look for in an Enterprise with CRON Important with CRON Workload Increased Automation Solution Increased Security/ Failed Manual Compliance Jobs/ Effort Risk Missed SLAs Advanced Job Scheduling. CRON only Static and limited • Dynamic, event-driven scheduling of offers time based job scheduling by options in job complex job-streams with support awakening at one minute intervals to scheduling hinders for If/Then/Else constructs, built-in start scheduled jobs representing script the ability to see functions and symbolic substitution or command processes. how jobs or system so scheduling decisions can be activity affect other made in real-time. job streams or • Scheduling based on the status processes. of other jobs and system activity such as file or database updates in addition to date/time scheduling. Workload Correlation/Relationships. If a job fails or is not • Support for scheduling of job- With CRON you can’t correlate one scheduled correctly, streams that map to business job to the next or alter the flow of incorrect data feeds applications. processing in a job-stream. can be passed to • Job-streams that “break-out” other jobs. complex internal scripts and processes that are error prone and run them as discrete jobs/tasks as part of a business-oriented work- flow. Job Status and Completion Detail. Time-sensitive • Advanced notification of job status CRON can’t tell if a job has finished processing and the ability to take action when early or late, and determining the requirements jobs finish early or late. status of jobs usually involves manual are unreliable, • Prediction of when jobs will checks. increasing error- complete and determine if they are prone manual tasks. on the critical path. Job Error Resolution. In CRON, a Increased time and • Simulation of work-flows to identify problem with processing typically effort required for errors prior to the workload requires manual intervention. identifying and becoming active. rectifying problems • Alert generation of failed or overdue can impact SLAs jobs which may negatively impact and potentially service level agreements. result in penalties. • Automatically identify errors and initiate corrective measures, or notification. Artificial Time Windows and Polling. Using arbitrary • Flexible scheduling using absolute Artificial time windows are often time windows and or relative time-frames or, more necessary in CRON and multiple polling intervals dynamically, based on other system job executions are often required to increases the activities such as file arrival or provide “polling.” batch window and database update. must be revised as • The ability to adjust job-streams workload volumes automatically to reflect critical or job times jobs and the current status of the increase. workflow. “We reduced our operational hours by replacing CRON with Impact Level Key: CA Workload Automation. Scheduling is easy and reliable with Low Medium High CA Workload Automation.” – Transportation Company CA Workload Automation Reference Guide Key Capabilities and What You Get Why This is Potential Impact to Your Business What to Look for in an Enterprise with CRON Important with CRON Workload Increased Automation Solution Increased Security/ Failed Manual Compliance Jobs/ Effort Risk Missed SLAs Cross Organization Workload Support staff • The ability to define, monitor and Management and Visualization. CRON typically access control all aspects of scheduled delivers limited workload visibility since several machines to workload from a central graphical there is no centralized monitoring or monitor processing interface across servers, operating control. and determine the systems and geographical locations. success or failure • Schedule workloads across of individual jobs disparate platforms such as Unix, which can involve Linux, Windows, i5/OS and z/OS, in time delays and addition to ERP solutions. missed errors. Failover Capabilities/Fault Tolerance. If outages occur, • High availability capabilities to CRON does not have failover it takes longer to automatically move the scheduler capabilities in the event of an outage of recover processing from one server to another in the the server on which it is installed. which impacts event of an outage. business continuity. • Support of clustering technology to enable jobs to be routed to different servers. Restart and Recovery. Manual process Manual recovery • Automatically resubmit a process to restart in CRON unless extensive requires or initiate notification and backout/ scripting has been integrated. investigation and recovery routines. is time consuming • Ability to recognize and take action and subject to based on generated exit codes. errors. Audit Trails/Compliance. CRON’s audit It is difficult to • Detailed logging to enable the trail capabilities are limited. determine which tracking and determination of users interacted potential errors during processing. with the schedule • Audit trail capabilities to determine or where processes who performed certain actions and encountered an when. error. “CA Workload Automation has made it easier for our Impact Level Key: application users to monitor their batch jobs by reducing Low Medium High reliance on system tools such as CRON. It has allowed us to manage all our workloads through a single point of control.” – Telco Company For more information, please visit ca.com/wla. For product information and a complete list of distributors, visit our website at: broadcom.com Copyright © 2019 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. Broadcom, the pulse logo, Connecting everything, CA Technologies, and the CA technologies logo are among the trademarks of Broadcom. CS200-155458-0519 May 23, 2019.
Load more

Recommended publications
  • Administering Unidata on UNIX Platforms
    C:\Program Files\Adobe\FrameMaker8\UniData 7.2\7.2rebranded\ADMINUNIX\ADMINUNIXTITLE.fm March 5, 2010 1:34 pm Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta UniData Administering UniData on UNIX Platforms UDT-720-ADMU-1 C:\Program Files\Adobe\FrameMaker8\UniData 7.2\7.2rebranded\ADMINUNIX\ADMINUNIXTITLE.fm March 5, 2010 1:34 pm Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Beta Notices Edition Publication date: July, 2008 Book number: UDT-720-ADMU-1 Product version: UniData 7.2 Copyright © Rocket Software, Inc. 1988-2010. All Rights Reserved. Trademarks The following trademarks appear in this publication: Trademark Trademark Owner Rocket Software™ Rocket Software, Inc. Dynamic Connect® Rocket Software, Inc. RedBack® Rocket Software, Inc. SystemBuilder™ Rocket Software, Inc. UniData® Rocket Software, Inc. UniVerse™ Rocket Software, Inc. U2™ Rocket Software, Inc. U2.NET™ Rocket Software, Inc. U2 Web Development Environment™ Rocket Software, Inc. wIntegrate® Rocket Software, Inc. Microsoft® .NET Microsoft Corporation Microsoft® Office Excel®, Outlook®, Word Microsoft Corporation Windows® Microsoft Corporation Windows® 7 Microsoft Corporation Windows Vista® Microsoft Corporation Java™ and all Java-based trademarks and logos Sun Microsystems, Inc. UNIX® X/Open Company Limited ii SB/XA Getting Started The above trademarks are property of the specified companies in the United States, other countries, or both. All other products or services mentioned in this document may be covered by the trademarks, service marks, or product names as designated by the companies who own or market them. License agreement This software and the associated documentation are proprietary and confidential to Rocket Software, Inc., are furnished under license, and may be used and copied only in accordance with the terms of such license and with the inclusion of the copyright notice.
    [Show full text]
  • Geek Guide > Beyond Cron
    GEEK GUIDE BEYOND CRON Table of Contents Ease of Use ..................................................................... 8 Multi-Server-Friendly .................................................... 10 Dependency Management ............................................ 13 Easy to Visualize ........................................................... 16 Delegation of Authority ................................................. 18 Management by Exception ........................................... 21 Flexible Scheduling ....................................................... 23 Revision Control ........................................................... 24 Conclusion .................................................................... 24 MIKE DIEHL has been using Linux since the days when Slackware came on 14 5.25” floppy disks and installed kernel version 0.83. He has built and managed several servers configured with either hardware or software RAID storage under Linux, and he has hands-on experience with both the VMware and KVM virtual machine architectures. Mike has written numerous articles for Linux Journal on a broad range of subjects, and he has a Bachelor’s degree in Mathematics with a minor in Computer Science. He lives in Blythewood, South Carolina, with his wife and four sons. 2 GEEK GUIDE BEYOND CRON GEEK GUIDES: Mission-critical information for the most technical people on the planet. Copyright Statement © 2015 Linux Journal. All rights reserved. This site/publication contains materials that have been created, developed or
    [Show full text]
  • Introduction to Cron - Goals
    Introduction to cron - Goals • Goals: – Understand how cron works – Understand crontab files – Understand our conventions 1 What is cron? • cron is a Unix daemon program • cron automatically runs programs at given times • cron is different from at, which is a queued batch job facility • We are moving to use cron for batch jobs, as opposed to at 2 Crontab files (Part 1) • Each user on each machine has a crontab file. • So, ecogdev has its own file on each of sid & soltrane, as does ecogdba. • This file consists of lines that look like this: 15 03 * * * /ecog/ecogdev/src/reports/timezone/timezoneauto 15 03 * * 0 /ecog/ecogdev/src/reports/swog_prots/swog_protsauto 30 0 * * * /ecog/ecogdev/bin/ftpschema 3 Crontab Files (Part 2) • Here is one line from a crontab file: 30 0 * * * /ecog/ecogdev/bin/ftpschema • Six fields on this line (* is a wildcard): – 1. Minute of the hour (0-59) – 2. Hour of the day (0-23) – 3. Day of the month (0-31) – 4. Month of the year (1-12) – 5. Day of the week (0-6 with 0=Sunday) – 6. Command line • Quiz: When does this job run? 4 Crontab Files (Part 3) • Here is that crontab line again: 30 0 * * * /ecog/ecogdev/bin/ftpschema • The rightmost field is the command line • Best to use absolute paths, as in this entry • Commands can be executable programs or shell scripts • Put #!/bin/csh at top of C Shell scripts 5 The crontab command • The crontab command allows you to install and edit per-user crontab files. • These are the installed crontab files.
    [Show full text]
  • Unix (And Linux)
    AWK....................................................................................................................................4 BC .....................................................................................................................................11 CHGRP .............................................................................................................................16 CHMOD.............................................................................................................................19 CHOWN ............................................................................................................................26 CP .....................................................................................................................................29 CRON................................................................................................................................34 CSH...................................................................................................................................36 CUT...................................................................................................................................71 DATE ................................................................................................................................75 DF .....................................................................................................................................79 DIFF ..................................................................................................................................84
    [Show full text]
  • Solaris Crontab - NCCCS Systems Office Wiki
    Solaris crontab - NCCCS Systems Office Wiki http://localhost:8000/NCCCS/solaris-crontab#preview Solaris crontab crontab Access Control Here is a quick cheat sheet on how to add a crontab for a non-root user on Solaris 8. The datatel user will require permissions to be added so it can add entries in the crontab. Users: Access to crontab is allowed: if the user's name appears in /etc/cron.d/cron.allow. if /etc/cron.d/cron.allow does not exist and the user's name is not in /etc/cron.d/cron.deny. Users: Access to crontab is denied: if /etc/cron.d/cron.allow exists and the user's name is not in it. if /etc/cron.d/cron.allow does not exist and user's name is in /etc/cron.d/cron.deny. if neither file exists, only a user with the solaris.jobs.user authorization is allowed to submit a job. Note that the rules for allow and deny apply to root only if the allow/deny files exist. The allow/deny files consist of one user name per line. A prompt of # means you are logged in as the root user. A prompt of $ means you are logged in as the datatel user. Quick one-liner to add entry # echo "datatel" >> /etc/cron.d/cron.allow How to verify # cd /etc/cron.d # pwd /etc/cron.d # cat cron.allow adm lp root datatel 1 of 2 9/27/2005 1:14 PM Solaris crontab - NCCCS Systems Office Wiki http://localhost:8000/NCCCS/solaris-crontab#preview # cat cron.deny daemon bin smtp nuucp listen nobody noaccess Copyright 2005 - J.
    [Show full text]
  • Running a PHP Script on a Regular Schedule Using Curl and Cron
    Running a PHP script on a regular schedule using curl and cron. Under normal circumstances a PHP script is only executed when someone requests it via the web by clicking on a link or typing the URL into the location bar. However, on occasion, you may want a script to do something at a regular interval instead – perhaps to rebuild a “daily graphic” or send nightly email. In these circumstances, you need to trigger the script using a different mechanism than random web access. That’s what this note is about. The following discussion assumes you have created a PHP script that performs the necessary actions when accessed via the web. In this case, that script is called “cron-demo.php” and is stored in a folder called “cron” off of the user’s root web folder (aka “public_html” on a UW server). [Note: real uw netids need to replace “uwnetid” in each of the three places it occurs below!] [public_html/cron/cron-demo.php] <?php // ---- EMAIL test script for PHP ------ $to = [email protected]'; $subject = 'Cron Test'; $message = 'Greetings from planet krypton where it is currently ' .date("l dS \of F Y h:i:s A"); $headers = 'From: [email protected]' . "\r\n" . 'Reply-To: [email protected]' . "\r\n" . 'X-Mailer: PHP/' . phpversion(); mail($to, $subject, $message, $headers); print" Script complete.\n"; ?> The next step is to create an operating system script (called a “shell script”) that uses an operating system utility called “curl” to access your PHP script via the web. This file is also stored in a folder called “cron” but located just off the user’s “normal” home or root folder (i.e.
    [Show full text]
  • Automating Admin Tasks Using Shell Scripts and Cron Vijay Kumar Adhikari
    AutomatingAutomating adminadmin taskstasks usingusing shellshell scriptsscripts andand croncron VijayVijay KumarKumar AdhikariAdhikari vijayvijay@@kcmkcm..eduedu..npnp HowHow dodo wewe go?go? IntroductionIntroduction toto shellshell scriptsscripts ExampleExample scriptsscripts IntroduceIntroduce conceptsconcepts atat wewe encounterencounter themthem inin examplesexamples IntroductionIntroduction toto croncron tooltool ExamplesExamples ShellShell The “Shell” is a program which provides a basic human-OS interface. Two main ‘flavors’ of Shells: – sh, or bourne shell. It’s derivatives include ksh (korn shell) and now, the most widely used, bash (bourne again shell). – csh or C-shell. Widely used form is the very popular tcsh. – We will be talking about bash today. shsh scriptscript syntaxsyntax The first line of a sh script must (should?) start as follows: #!/bin/sh (shebang, http://en.wikipedia.org/wiki/Shebang ) Simple unix commands and other structures follow. Any unquoted # is treated as the beginning of a comment until end-of-line Environment variables are $EXPANDED “Back-tick” subshells are executed and `expanded` HelloHello WorldWorld scriptscript #!/bin/bash #Prints “Hello World” and exists echo “Hello World” echo “$USER, your current directory is $PWD” echo `ls` exit #Clean way to exit a shell script ---------------------------------------- To run i. sh hello.sh ii. chmod +x hello.sh ./hello.sh VariablesVariables MESSAGE="Hello World“ #no $ SHORT_MESSAGE=hi NUMBER=1 PI=3.142 OTHER_PI="3.142“ MIXED=123abc new_var=$PI echo $OTHER_PI # $ precedes when using the var Notice that there is no space before and after the ‘=‘. VariablesVariables contcont…… #!/bin/bash echo "What is your name?" read USER_NAME # Input from user echo "Hello $USER_NAME" echo "I will create you a file called ${USER_NAME}_file" touch "${USER_NAME}_file" -------------------------------------- Exercise: Write a script that upon invocation shows the time and date and lists all logged-in users.
    [Show full text]
  • Linux Crontab: 15 Awesome Cron Job Examples
    Linux Crontab: 15 Awesome Cron Job Examples < An experienced Linux sysadmin knows the importance of running the routine maintenance jobs in the background automatically. Linux Cron utility is an effective way to schedule a routine background job at a specific time and/or day on an on- going basis. In this article, let us review 15 awesome examples of crontab job scheduling. Linux Crontab Format PRO version Are you a developer? Try out the HTML to PDF API pdfcrowd.com MIN HOUR DOM MON DOW CMD Table: Crontab Fields and Allowed Ranges (Linux Crontab Syntax) Field Description Allowed Value MIN Minute field 0 to 59 HOURHour field 0 to 23 DOM Day of Month 1-31 MON Month field 1-12 DOW Day Of Week0-6 CMD Command Any command to be executed. 1. Scheduling a Job For a Specific Time The basic usage of cron is to execute a job in a specific time as shown below. This will execute the Full backup shell script (full-backup) on 10th June 08:30 AM. Please note that the time field uses 24 hours format. So, for 8 AM use 8, and for 8 PM use 20. 30 08 10 06 * /home/ramesh/full-backup 30 – 30th Minute 08 – 08 AM 10 – 10th Day 06 – 6th Month (June) * – Every day of the week 2. Schedule a Job For More Than One Instance (e.g. Twice a Day) PRO version Are you a developer? Try out the HTML to PDF API pdfcrowd.com The following script take a incremental backup twice a day every day.
    [Show full text]
  • BASH Programming − Introduction HOW−TO BASH Programming − Introduction HOW−TO
    BASH Programming − Introduction HOW−TO BASH Programming − Introduction HOW−TO Table of Contents BASH Programming − Introduction HOW−TO.............................................................................................1 by Mike G mikkey at dynamo.com.ar.....................................................................................................1 1.Introduction...........................................................................................................................................1 2.Very simple Scripts...............................................................................................................................1 3.All about redirection.............................................................................................................................1 4.Pipes......................................................................................................................................................1 5.Variables...............................................................................................................................................2 6.Conditionals..........................................................................................................................................2 7.Loops for, while and until.....................................................................................................................2 8.Functions...............................................................................................................................................2
    [Show full text]
  • Linux Shell Scripting Cookbook Second Edition
    Linux Shell Scripting Cookbook Second Edition Over 110 practical recipes to solve real-world shell problems, guaranteed to make you wonder how you ever lived without them Shantanu Tushar Sarath Lakshman BIRMINGHAM - MUMBAI Linux Shell Scripting Cookbook Second Edition Copyright © 2013 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the authors, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. First published: January 2011 Second edition: May 2013 Production Reference: 1140513 Published by Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK. ISBN 978-1-78216-274-2 www.packtpub.com Cover Image by Parag Kadam ([email protected]) Credits Authors Project Coordinator Shantanu Tushar Shiksha Chaturvedi Sarath Lakshman Proofreader Reviewers Linda Morris Rajeshwari K. John C. Kennedy Indexer Hemangini Bari Anil Kumar Sudhendu Kumar Production Coordinator Aravind SV Shantanu Zagade Acquisition Editor Cover Work Kartikey Pandey Shantanu Zagade Lead Technical Editor Ankita Shashi Technical Editors Jalasha D'costa Amit Ramadas Lubna Shaikh About the Authors Shantanu Tushar is an advanced GNU/Linux user since his college days.
    [Show full text]
  • LFCS Exam Name: Linux Foundation Certified System Administrator
    Vendor: Linux Foundation Exam Code: LFCS Exam Name: Linux Foundation Certified System Administrator Version: DEMO QUESTION 1 What is the output of the following command? echo "Hello World" | tr -d aieou A. Hello World B. eoo C. Hll Wrld D. eoo Hll Wrld Answer: C QUESTION 2 Given a file called birthdays containing lines like: YYYY-MM-DD Name 1983-06-02 Tim 1995-12-17 Sue Which command would you use to output the lines belonging to all people listed whose birthday is in May or June? A. grep '[56]' birthdays B. grep 05?6? birthdays C. grep '[0-9]*-0[56]-' birthdays D. grep 06 birthdays | grep 05 Answer: C QUESTION 3 Which keyword must be listed in the hosts option of the Name Service Switch configuration file in order to make host lookups consult the /etc/hosts file? Answer: files QUESTION 4 Which command can be used to delete a group from a Linux system? A. groupdel B. groupmod C. groups D. groupedit Answer: A QUESTION 5 How many IP-addresses can be used for unique hosts inside the IPv4 subnet 192.168.2.128/28? (Specify the number only without any additional information.) Answer: 14 QUESTION 6 What is the purpose of the command mailq? A. It fetches new emails from a remote server using POP3 or IMAP. B. It is a multi-user mailing list manager. C. It is a proprietary tool contained only in the qmail MTA. D. It queries the mail queue of the local MTA. E. It is a command-line based tool for reading and writing emails.
    [Show full text]
  • Unix Scripts and Job Scheduling
    UnixUnix ScriptsScripts andand JobJob SchedulingScheduling Michael B. Spring Department of Information Science and Telecommunications University of Pittsburgh [email protected] http://www.sis.pitt.edu/~spring OverviewOverview Ü Shell Scripts Shell script basics Variables in shell scripts Korn shell arithmetic Commands for scripts Flow control, tests, and expressions Making Scripts Friendlier Functions Pipes and Shell Scripts Scripts with awk and/or sed Ü Job Scheduling bg and at cron RunningRunning aa ShellShell ScriptScript Ü First three forms spawn a new process, so new variable values are not left when you return sh < filename – where sh is the name of a shell – does not allow arguments sh filename filename – Assumes directory in path – Assumes chmod +x filename . filename – Does not spawn a new shell. – Changes to system variables impact the current shell Ü you may exit a shell script by Getting to the last line Encountering an exit command Executing a command that results in an error condition that causes an exit. StructureStructure ofof aa ShellShell ScriptScript Ü Basic structure #! Program to execute script # comment Commands and structures Ü Line continuation | at the end of the line is an assumed continuation \ at the end of a line is an explicit continuation Ü # in a shell script indicates a comment to \n Ü Back quotes in command cause immediate execution and substitution DebuggingDebugging aa scriptscript Ü Use the command set –x within a script Ü You can also activate the following set options -n read commands before executing them – for testing scripts -u make it an error to reference a non existing file -v print input as it is read - disable the –x and –v commands Ü Set the variable PS4 to some value that will help – e.g.
    [Show full text]