Struct FileProcessor 

pub struct FileProcessor { /* private fields */ }

Unified file processor that handles both parallel and sequential processing

Implementations

impl FileProcessor

pub fn new() -> Self

Create a new file processor with default configuration

pub const fn with_config(config: ProcessorConfig) -> Self

Create a new file processor with custom configuration

pub fn process_files_streaming<T, F, A>( &self, files: &[String], line_processor: F, aggregator: A, initial: T, ) -> Result<(T, ProcessStats)>

where T: Send + Clone + Sync + 'static, F: FnMut(&AuditEntry, &mut T) + Send + Sync + Clone, A: Fn(T, T) -> T + Send + Sync,

Process multiple files with a streaming line-by-line processor

This is the main entry point for file processing. It automatically handles:

• Progress tracking with accurate totals and ETA
• Parallel or sequential processing based on configuration
• Error handling and context
• Memory-efficient streaming

Arguments

• files - List of file paths to process
• line_processor - Function that processes individual audit entries
• aggregator - Function that combines results from all files
• initial - Initial value for the aggregator

Example

let processor = FileProcessor::new();
let result = processor.process_files_streaming(
    &files,
    |entry, state| {
        // Process each audit entry
        state.counter += 1;
    },
    |acc, file_result| {
        // Combine results from each file
        acc.merge(file_result)
    },
    MyState::new(),
)?;

pub fn process_files_collect<T, F>( &self, files: &[String], processor: F, ) -> Result<(Vec<T>, ProcessStats)>

where T: Send + 'static, F: Fn(&str) -> Result<T> + Send + Sync,

Process multiple files and collect results into a collection

This is a convenience method for cases where you want to collect individual results from each file rather than aggregating.

Trait Implementations

impl Default for FileProcessor

fn default() -> Self

Returns the “default value” for a type.