[hadoop@9d2572ed7116 ~]$ yarn jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar grep input output 'dfs[a-z.]+' 2021-03-04 09:19:44,871 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 2021-03-04 09:19:46,187 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1614849552299_0001 2021-03-04 09:19:46,964 INFO input.FileInputFormat: Total input files to process : 9 2021-03-04 09:19:47,211 INFO mapreduce.JobSubmitter: number of splits:9 2021-03-04 09:19:47,738 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1614849552299_0001 2021-03-04 09:19:47,742 INFO mapreduce.JobSubmitter: Executing with tokens: [] 2021-03-04 09:19:48,611 INFO conf.Configuration: resource-types.xml not found 2021-03-04 09:19:48,624 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. 2021-03-04 09:19:49,467 INFO impl.YarnClientImpl: Submitted application application_1614849552299_0001 2021-03-04 09:19:49,704 INFO mapreduce.Job: The url to track the job: http://9d2572ed7116:8088/proxy/application_1614849552299_0001/ 2021-03-04 09:19:49,711 INFO mapreduce.Job: Running job: job_1614849552299_0001 2021-03-04 09:20:09,585 INFO mapreduce.Job: Job job_1614849552299_0001 running in uber mode : false 2021-03-04 09:20:09,588 INFO mapreduce.Job: map 0% reduce 0% 2021-03-04 09:20:58,210 INFO mapreduce.Job: map 22% reduce 0% 2021-03-04 09:20:59,379 INFO mapreduce.Job: map 67% reduce 0% 2021-03-04 09:21:34,861 INFO mapreduce.Job: map 78% reduce 0% 2021-03-04 09:21:35,907 INFO mapreduce.Job: map 89% reduce 0% 2021-03-04 09:21:36,937 INFO mapreduce.Job: map 100% reduce 0% 2021-03-04 09:21:38,976 INFO mapreduce.Job: map 100% reduce 100% 2021-03-04 09:21:39,992 INFO mapreduce.Job: Job job_1614849552299_0001 completed successfully 2021-03-04 09:21:40,285 INFO mapreduce.Job: Counters: 55 File System Counters FILE: Number of bytes read=51 FILE: Number of bytes written=2349895 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=27497 HDFS: Number of bytes written=143 HDFS: Number of read operations=32 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 HDFS: Number of bytes read erasure-coded=0 Job Counters Killed map tasks=2 Launched map tasks=11 Launched reduce tasks=1 Data-local map tasks=11 Total time spent by all maps in occupied slots (ms)=411934 Total time spent by all reduces in occupied slots (ms)=36924 Total time spent by all map tasks (ms)=411934 Total time spent by all reduce tasks (ms)=36924 Total vcore-milliseconds taken by all map tasks=411934 Total vcore-milliseconds taken by all reduce tasks=36924 Total megabyte-milliseconds taken by all map tasks=421820416 Total megabyte-milliseconds taken by all reduce tasks=37810176 Map-Reduce Framework Map input records=713 Map output records=2 Map output bytes=41 Map output materialized bytes=99 Input split bytes=1077 Combine input records=2 Combine output records=2 Reduce input groups=2 Reduce shuffle bytes=99 Reduce input records=2 Reduce output records=2 Spilled Records=4 Shuffled Maps =9 Failed Shuffles=0 Merged Map outputs=9 GC time elapsed (ms)=7651 CPU time spent (ms)=7560 Physical memory (bytes) snapshot=2221596672 Virtual memory (bytes) snapshot=25281732608 Total committed heap usage (bytes)=1573556224 Peak Map Physical memory (bytes)=234405888 Peak Map Virtual memory (bytes)=2527686656 Peak Reduce Physical memory (bytes)=129363968 Peak Reduce Virtual memory (bytes)=2533957632 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=26420 File Output Format Counters Bytes Written=143 2021-03-04 09:21:40,425 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 2021-03-04 09:21:40,513 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1614849552299_0002 2021-03-04 09:21:41,091 INFO input.FileInputFormat: Total input files to process : 1 2021-03-04 09:21:41,296 INFO mapreduce.JobSubmitter: number of splits:1 2021-03-04 09:21:41,494 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1614849552299_0002 2021-03-04 09:21:41,495 INFO mapreduce.JobSubmitter: Executing with tokens: [] 2021-03-04 09:21:41,605 INFO impl.YarnClientImpl: Submitted application application_1614849552299_0002 2021-03-04 09:21:41,655 INFO mapreduce.Job: The url to track the job: http://9d2572ed7116:8088/proxy/application_1614849552299_0002/ 2021-03-04 09:21:41,657 INFO mapreduce.Job: Running job: job_1614849552299_0002 2021-03-04 09:22:06,441 INFO mapreduce.Job: Job job_1614849552299_0002 running in uber mode : false 2021-03-04 09:22:06,442 INFO mapreduce.Job: map 0% reduce 0% 2021-03-04 09:22:18,810 INFO mapreduce.Job: map 100% reduce 0% 2021-03-04 09:22:31,007 INFO mapreduce.Job: map 100% reduce 100% 2021-03-04 09:22:31,045 INFO mapreduce.Job: Job job_1614849552299_0002 completed successfully 2021-03-04 09:22:31,224 INFO mapreduce.Job: Counters: 54 File System Counters FILE: Number of bytes read=51 FILE: Number of bytes written=468861 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=275 HDFS: Number of bytes written=29 HDFS: Number of read operations=9 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 HDFS: Number of bytes read erasure-coded=0 Job Counters Launched map tasks=1 Launched reduce tasks=1 Data-local map tasks=1 Total time spent by all maps in occupied slots (ms)=9721 Total time spent by all reduces in occupied slots (ms)=9107 Total time spent by all map tasks (ms)=9721 Total time spent by all reduce tasks (ms)=9107 Total vcore-milliseconds taken by all map tasks=9721 Total vcore-milliseconds taken by all reduce tasks=9107 Total megabyte-milliseconds taken by all map tasks=9954304 Total megabyte-milliseconds taken by all reduce tasks=9325568 Map-Reduce Framework Map input records=2 Map output records=2 Map output bytes=41 Map output materialized bytes=51 Input split bytes=132 Combine input records=0 Combine output records=0 Reduce input groups=1 Reduce shuffle bytes=51 Reduce input records=2 Reduce output records=2 Spilled Records=4 Shuffled Maps =1 Failed Shuffles=0 Merged Map outputs=1 GC time elapsed (ms)=224 CPU time spent (ms)=1560 Physical memory (bytes) snapshot=365690880 Virtual memory (bytes) snapshot=5061750784 Total committed heap usage (bytes)=230821888 Peak Map Physical memory (bytes)=236060672 Peak Map Virtual memory (bytes)=2527485952 Peak Reduce Physical memory (bytes)=129630208 Peak Reduce Virtual memory (bytes)=2534264832 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=143 File Output Format Counters Bytes Written=29 [hadoop@9d2572ed7116 ~]$ hdfs dfs -get output output [hadoop@9d2572ed7116 ~]$ cat output/* 1 dfsadmin 1 dfs.replication [hadoop@9d2572ed7116 ~]$