Using and Administering

llsummary - Return Job Resource Information for Accounting

Purpose

Returns job resource information on completed jobs for accounting purposes.

Syntax

llsummary [-?] [-H] [-v] [-x] [-l] [-s MM/DD/YYYY to MM/DD/YYYY] [-e MM/DD/YYYY to MM/DD/YYYY] [-u user] [-c class] [-g group] [-G unixgroup] [-a allocated] [-r report] [-j host.jobid] [-d section] [filename]

Flags

-?
Provides a short usage message.

-H
Provides extended help information.

-v
Outputs the name of the command, release number, service level, service level date, and operating system used to build the command.

-x
Provides extended information. Using -x can produce a very long report. This option is meaningful only when used with the -l option. You must enable the recording of accounting data in order to collect information with the -x flag. To do this, specify ACCT=A_ON A_DETAIL in your LoadL_config file.

-l
Specifies that the long form of output is displayed.

-s
Specifies a range for the start date (queue date) for accounting data to be included in this report. The format for entering the date is either MM/DD/YYYY (where MM is month, DD is day, and YYYY is year), MM/DD/YY (where YY is a two-digit year value), or a string of digits representing the number of seconds since 1970. If a two-digit year value is used, then 69-99 maps to 1969-1999, and 00-68 maps to 2000-2068. The default is to include all the data in the report.

-e
Specifies a range for the end date (completion date) for accounting data to be included in this report. The format for entering the date is either MM/DD/YYYY (where MM is month, DD is day, and YYYY is year), MM/DD/YY (where YY is a two-digit year value), or a string of digits representing the number of seconds since 1970. The default is to include all the data in the report.

-u user
Specifies the user ID for whom accounting data is reported.

-c class
Specifies the class for which accounting data is reported. For reports of all formats (short, long and extended), llsummary will report information about every job which contains at least one step of the specified class. For the short format, llsummary also reports a job count and step count for each class; for these counts, a job's class is determined by the class of its first step.

-g group
Specifies the LoadLeveler group for which accounting data is reported. For reports of all formats (short, long and extended), llsummary reports information about every job which contains at least one step of the specified group. For the short format, llsummary also reports a job count and step count for each group; for these counts, a job's group is determined by the group of its first step.

-G unixgroup
Specifies the UNIX group for which accounting data is reported.

-a allocated
Specifies the hostname that was allocated to run the job. You can specify the allocated host in short or long form.

-r report
Specifies the report type. You can choose one or more of the following reports:

resource
Provides CPU usage for all submitted jobs, including those that did not run. This is the default.

avgthroughput
Provides average queue time, run time, and CPU time for jobs that ran for at least some period of time.

maxthroughput
Provides maximum queue time, run time, and CPU time for jobs that ran for at least some period of time.

minthroughput
Provides minimum queue time, run time, and CPU time for jobs that ran for at least some period of time.

throughput
Selects all throughput reports.

numeric
Reports CPU times in seconds rather than hours, minutes, and seconds

You must enable the recording of accounting data in order to generate any of the four throughput reports. To do this, specify ACCT=A_ON A_DETAIL in your LoadL_config file.

-d section
Specifies the category (data section) for which you want to generate a report. You can specify one or more of the following: user, group, unixgroup, class, account, day, week, month, jobid, jobname, allocated.

-j host.jobid
The job for which accounting data is reported. host is the name of the machine to which the job was submitted. The default is the local machine. jobid is the job ID assigned to the job when it was submitted using the llsubmit command. The entire host.jobid string is required.

filename
The file containing the accounting data. If not specified, the default is the local history file on the machine from which the command was issued. You can use the llacctmrg command to produce such a file.

Examples

The following example requests summary reports (standard listing) of all the jobs submitted on your machine between the days of September 12, 1999 and October 12, 1999:

llsummary -s 09/12/1999 to 10/12/1999

Results

The Standard Listing: The standard listing is generated when you do not specify -l. -r, or -d with llsummary. This sample report includes summaries of the following data:

The following is an example of the standard listing:

+--------------------------------------------------------------------------------+
|       Name   Jobs   Steps        Job Cpu    Starter Cpu     Leverage           |
|    krystal     15      36     0+00:09:50     0+00:00:10         59.0           |
|     lixin3     18      54     0+00:08:28     0+00:00:16         31.8           |
|      TOTAL     33      90     0+00:18:18     0+00:00:27         40.7           |
|                                                                                |
|      Class   Jobs   Steps        Job Cpu    Starter Cpu     Leverage           |
|      small      9      21     0+00:01:03     0+00:00:06         10.5           |
|      large     12      36     0+00:13:45     0+00:00:11         75.0           |
|       osl2      3       9     0+00:00:27     0+00:00:02         13.5           |
|   No_Class      9      24     0+00:03:01     0+00:00:06         30.2           |
|      TOTAL     33      90     0+00:18:18     0+00:00:27         40.7           |
|                                                                                |
|      Group   Jobs   Steps        Job Cpu    Starter Cpu     Leverage           |
|   No_Group     12      30     0+00:09:32     0+00:00:09         63.6           |
|  chemistry      7      18     0+00:04:50     0+00:00:05         58.0           |
|engineering     14      42     0+00:03:56     0+00:00:12         19.7           |
|  TOTAL         33      90     0+00:18:18     0+00:00:27         40.7           |
|                                                                                |
|    Account   Jobs   Steps        Job Cpu    Starter Cpu     Leverage           |
|      33333     16      39     0+00:05:54     0+00:00:11         32.2           |
|      22222     15      45     0+00:12:05     0+00:00:13         55.8           |
|      99999      2       6     0+00:00:18     0+00:00:01         18.0           |
|      TOTAL     33      90     0+00:18:18     0+00:00:27         40.7           |
|                                                                                |
|                                                                                |
+--------------------------------------------------------------------------------+

The standard listing includes the following fields:

Name
User ID submitting jobs.

Class
Class specified or defaulted for the jobs.

Group
User's login group.

Account
Account number specified for the jobs.

Jobs
Count of the total number of jobs submitted by this user, class, group, or account.

Steps
Count of the total number of job steps submitted by this user, class, group, or account.

Job CPU
Total CPU time consumed by user's jobs.

Starter CPU
Total CPU time consumed by LoadLeveler starter processes on behalf of the user jobs.

Leverage
Ratio of job CPU to starter CPU.

The -r Listing: The following is sample output from the llsummary -r throughput command. Only the user output is shown; the class, group, and account lines are not shown.

+--------------------------------------------------------------------------------+
|   Name   Jobs   Steps   AvgQueueTime    AvgRealTime     AvgCPUTime             |
|  loadl      1       4     0+00:00:03     0+00:05:27     0+00:05:17             |
|  user1      2       6     0+00:03:05     0+00:03:45     0+00:03:04             |
|    ALL      3      10     0+00:01:52     0+00:04:26     0+00:03:58             |
|                                                                                |
|   Name   Jobs   Steps   MinQueueTime    MinRealTime     MinCPUTime             |
|  loadl      1       4     0+00:00:01     0+00:02:49     0+00:02:44             |
|  user1      2       6     0+00:02:02     0+00:03:43     0+00:03:02             |
|    ALL      3      10     0+00:00:01     0+00:02:49     0+00:02:44             |
|                                                                                |
|   Name   Jobs   Steps   MaxQueueTime    MaxRealTime     MaxCPUTime             |
|  loadl      1       4     0+00:00:06     0+00:12:58     0+00:12:37             |
|  user1      2       6     0+00:06:21     0+00:03:48     0+00:03:07             |
|    ALL      3      10     0+00:06:21     0+00:12:58     0+00:12:37             |
+--------------------------------------------------------------------------------+

The -r listing includes the following fields:

AvgQueueTime
Average amount of time the job spent queued before running for this user, class, group, or account.

AvgRealTime
Average amount of accumulated wall clock time for jobs associated with this user, class, group, or account.

AvgCPUTime
Average amount of accumulated CPU time for jobs associated with this user, class, group, or account.

MinQueueTime
Time of the job that spent the least amount of time in queue before running for this user, class, group, or account.

MinRealTime
Time of the job with the least amount of wall clock time for this user, class, group, or account.

MinCPUime
Time of the job with the least amount of CPU time for this user, class, group, or account.

The MaxQueueTime, MaxRealTime, and MaxCPUTime fields display the time of the job with the greatest amount of queue, wall clock, and CPU time, respectively. The ALL line for the Average listing displays the average time for all users, classes, groups, and accounts. The ALL line for the Minimum listing displays the time of the job with the least amount of time for all users, classes, groups, and accounts. The ALL line for the Maximum listing displays the time of the job with the greatest amount of time for all users, classes, groups, and accounts.

The Long Listing: When you specify the -x option in conjunction with the -l option on the llsummary command, the long report resembles the following:

+--------------------------------------------------------------------------------+
|================== Job c163n12.ppd.pok.ibm.com 10 ==================            |
|             Job Id: c163n12.ppd.pok.ibm.com 10                                 |
|           Job Name: c163n12.ppd.pok.ibm.com.10                                 |
|  Structure Version: 210                                                        |
|              Owner: loadl                                                      |
|         Unix Group: loadl                                                      |
|    Submitting Host: c163n12.ppd.pok.ibm.com                                    |
|  Submitting Userid: 1064                                                       |
| Submitting Groupid: 222                                                        |
|    Number of Steps: 1                                                          |
|                                                                                |
+--------------------------------------------------------------------------------+
+--------------------------------------------------------------------------------+
|------------------ Step c163n12.ppd.pok.ibm.com.10.0 ------------------         |
|        Job Step Id: c163n12.ppd.pok.ibm.com.10.0                               |
|          Step Name: 0                                                          |
|         Queue Date: Mon Jun 28 11:27:28 EDT 1999                               |
|         Dependency:                                                            |
|             Status: Completed                                                  |
|      Dispatch Time: Mon Jun 28 11:27:28 EDT 1999                               |
|    Completion Date: Mon Jun 28 11:37:48 EDT 1999                               |
|    Completion Code: 0                                                          |
|        Start Count: 1                                                          |
|      User Priority: 50                                                         |
|       user_sysprio: 50                                                         |
|      class_sysprio: 30                                                         |
|      group_sysprio: 0                                                          |
|      Notifications: Complete                                                   |
| Virtual Image Size: 376 kilobytes                                              |
|         Checkpoint: no                                                         |
|            Restart: yes                                                        |
|     Hold Job Until:                                                            |
|                Cmd: /bin/poe                                                   |
|               Args: /test/loadl/ivp_600 -euilib us -ilevel 6 -labelio yes -pmdl|
|                Env: MANPATH=/usr/local/man:/usr/share/man; LANG=en_US; LOGIN= ..|
|                 In: /dev/null                                                  |
|                Out: poe5_1.c163n12.10.0.out                                    |
|                Err: poe5_1.c163n12.10.0.err                                    |
|Initial Working Dir: /test/loadl                                                |
|       Requirements: (Arch == "R6000") && (OpSys == "AIX43")                    |
|        Preferences:                                                            |
|          Step Type: General Parallel                                           |
|     Min Processors: 2                                                          |
|     Max Processors: 2                                                          |
|  Alloc. Host Count: 2                                                          |
|     Allocated Host: c163n12.ppd.pok.ibm.com                                    |
|                     c163n11.ppd.pok.ibm.com                                    |
|         Node Usage: shared                                                     |
|        Notify User: loadl                                                      |
|              Shell: /bin/ksh                                                   |
|  LoadLeveler Group: No_Group                                                   |
|              Class: Parallel                                                   |
|     Cpu Hard Limit: 3600 seconds                                               |
|     Cpu Soft Limit: 1200 seconds                                               |
|    Data Hard Limit: -1                                                         |
|    Data Soft Limit: -1                                                         |
|    Core Hard Limit: -1                                                         |
|    Core Soft Limit: -1                                                         |
|    File Hard Limit: -1                                                         |
|    File Soft Limit: -1                                                         |
|   Stack Hard Limit: -1                                                         |
|   Stack Soft Limit: -1                                                         |
|     Rss Hard Limit: -1                                                         |
|     Rss Soft Limit: -1                                                         |
|Step Cpu Hard Limit: 5400 seconds                                               |
|Step Cpu Soft Limit: 2400 seconds                                               |
|Wall Clk Hard Limit: 6000 seconds                                               |
|Wall Clk Soft Limit: 3600 seconds                                               |
|            Comment:                                                            |
|            Account: 99999                                                      |
|   NQS Submit Queue:                                                            |
|   NQS Query Queues:                                                            |
|  Job Tracking Exit:                                                            |
|  Job Tracking Args:                                                            |
|      Task_geometry:                                                            |
|          Resources:                                                            |
|           Blocking: UNSPECIFIED                                                |
|                                                                                |
+--------------------------------------------------------------------------------+

+--------------------------------------------------------------------------------+
|--------------- Detail for c163n12.ppd.pok.ibm.com.10.0 ---------------         |
|       Running Host: c163n12.ppd.pok.ibm.com                                    |
|      Machine Speed: 1.000000                                                   |
|              Event: System                                                     |
|         Event Name: started                                                    |
|      Time of Event: Mon Jun 28 11:27:28 EDT 1999                               |
|  Starter User Time:   0+00:00:00.0                                             |
|Starter System Time:   0+00:00:00.0                                             |
| Starter Total Time:   0+00:00:00.0                                             |
|                ...                                                             |
|                ...                                                             |
|              Event: System                                                     |
|         Event Name: completed                                                  |
|      Time of Event: Mon Jun 28 11:37:48 EDT 1999                               |
|  Starter User Time:   0+00:00:00.140000                                        |
|Starter System Time:   0+00:00:00.190000                                        |
| Starter Total Time:   0+00:00:00.330000                                        |
|     Starter maxrss: 1732                                                       |
|      Starter ixrss: 10720                                                      |
|                ...                                                             |
|                ...                                                             |
|       Running Host: c163n11.ppd.pok.ibm.com                                    |
|      Machine Speed: 1.000000                                                   |
|              Event: System                                                     |
|         Event Name: started                                                    |
|      Time of Event: Mon Jun 28 11:28:31 EDT 1999                               |
|  Starter User Time:   0+00:00:00.0                                             |
|Starter System Time:   0+00:00:00.0                                             |
| Starter Total Time:   0+00:00:00.0                                             |
|                ...                                                             |
|                ...                                                             |
|              Event: System                                                     |
|         Event Name: completed                                                  |
|      Time of Event: Mon Jun 28 11:38:41 EDT 1999                               |
|  Starter User Time:   0+00:00:00.150000                                        |
|Starter System Time:   0+00:00:00.190000                                        |
| Starter Total Time:   0+00:00:00.340000                                        |
| Starter maxrss: 1668                                                           |
|      Starter ixrss: 11088                                                      |
|      Starter idrss: 16452                                                      |
|      Starter isrss: 0                                                          |
|     Starter minflt: 1373                                                       |
|     Starter majflt: 0                                                          |
|      Starter nswap: 0                                                          |
|    Starter inblock: 0                                                          |
|    Starter oublock: 0                                                          |
|     Starter msgsnd: 0                                                          |
|     Starter msgrcv: 0                                                          |
|   Starter nsignals: 2                                                          |
|      Starter nvcsw: 50                                                         |
|     Starter nivcsw: 28                                                         |
|     Step User Time:   0+00:00:06.480000                                        |
|   Step System Time:   0+00:00:01.690000                                        |
|    Step Total Time:   0+00:00:08.170000                                        |
|        Step maxrss: 1292                                                       |
|         Step ixrss: 17960                                                      |
|         Step idrss: 437844                                                     |
|         Step isrss: 0                                                          |
|        Step minflt: 2433                                                       |
|        Step majflt: 2                                                          |
|         Step nswap: 0                                                          |
|       Step inblock: 0                                                          |
|       Step oublock: 0                                                          |
|        Step msgsnd: 0                                                          |
|        Step msgrcv: 0                                                          |
|      Step nsignals: 3058                                                       |
|         Step nvcsw: 155458                                                     |
|        Step nivcsw: 498                                                        |
|        Step CPUs: 18                                                           |
|        Step Virtual Memory: 180 megabytes                                      |
|        Step Real Memory: 90 megabytes                                          |
|        Step Adapter Memory: 2097152 bytes                                      |
+--------------------------------------------------------------------------------+

For an explanation of these fields, see the description of the output fields for the long listing of the llq command.


[ Top of Page | Previous Page | Next Page | Table of Contents | Index ]