International Journal of Intelligent Systems

Research Article

DLLog: An Online Log Parsing Approach for Large-Scale System

Table 1

Sample of raw log data.
CategoryNameLog data
Distributed systemHDFS081109 203521 146 INFO dfs. DataNode$Packet responder: received block blk_7503483334202473044 of size 233217 from/10.251.71.16
Hadoop2015-10-18 18:01:53,713 INFO [main] org. Apache. Hadoop. mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: <memory: 8192, vCores: 32>
Spark17/06/09 20:10:45 INFO executor.Executor: running task 2.0 in stage
OpenStackNova-compute.log.1.2017-05-16_13:55:31 2017-05-16 00:00:04.500 2931 INFO nova.compute.manager [req-3ea4052c-895d-4b64-9e2d-04d64c4d94ab - - - - -] [instance: b9000564-fela-409b-b8cc-1e88b294cd1d] VM started (lifecycle event)
Supercomputer systemBGL- 1134748483 2005.12.16 R60-M1-N7-C:J17-U01 2005-12-16-07.54.43.245870R60-M1-N7-C:J17-U01 RAS KERNEL INFO total of 20 ddr error(s) detected and corrected over 22070 seconds
Operating systemWindows2016-09-28 04:30:31, info CBS SQM: queued 0 file(s) for upload with pattern: C: windowsservicingsqm _all.sqm, flags: 0 × 6
LinuxJul 27 14:41:58 combo kernel: PCI: PCI BIOS revision 2.10 entry at 0xfc0ce, last bus = 1
Mobile systemAndroid03-17 16:16:07.635 1702 1820 D DisplayPowerController: animating brightness: target = 38, rate = 200