Module parallel

Module parallel 

Source
Expand description

Parallel file processing utilities.

This module provides high-performance parallel processing of multiple audit log files using Rayon for CPU-bound workloads. Files are processed concurrently with proper progress tracking and error handling.

Structs§

FileProcessResult
Result of processing a single file

Functions§

count_file_lines
Count lines in a file for progress tracking (lightweight)
process_file_streaming
Process a file with streaming to minimize memory usage
process_files_aggregate
Process multiple files with simple aggregation (sum, count, etc.)
process_files_parallel
Process multiple files in parallel with memory-efficient streaming