All Collections
Execute Pipelines
Power-searching Log and Output Files
Power-searching Log and Output Files
Gwenn Berry avatar
Written by Gwenn Berry
Updated over a week ago

With the Check File Content tool, Miqa allows you to search for a word, phrase, or other pattern across all of your log or output files.

Searching Log Files

To use the tool to filter log contents, start from the Logs overview page for your execution of interest. This page is accessible from the View All button in the Logs section of the Outputs card on the execution page.

Once on the Logs overview page, type in the pattern you would like to detect (e.g. "Error") into the search bar, and hit the button to execute the search.

This will open a new page that shows all log files on the left, along with the number of hits for the searched pattern in each file. In the example below, File1.log and File2.log each have 2 hits, as shown by the blue badges to the right of the file name.

If you click on the file in the list, the matching log content (including context lines before and after the matched line) will display in the right-hand panel of the page.

To search for a different pattern, change the Pattern field to a word, phrase, or regex of your choice. By default, results will show two lines of context before and after a matched line. To change the amount of context, edit the Context Lines field and click Submit.


Searching Non-Log Files

To search additional non-log files, try changing the dropdown to File Pattern and typing in a filename regex to the right, for example "metrics.txt" or "csv$". Make sure you have the Pattern field filled out, and click Submit to run the search on all files matching that pattern.

Please note: pipelines with binary, very large, or other non-human-readable file outputs should avoid using the Outputs option of the dropdown menu or specifying broad-matching file patterns (including blank/*) to avoid undesired performance issues.

Did this answer your question?