FASTQ format

Probability metrics

FASTQ format is a text-based format for storing both a biological sequence (usually nucleotide sequences) and its corresponding quality scores. Both the sequence letter and quality score are each encoded with a single ASCII character for brevity. It is commonly used in high-throughput sequencing workflows, such as those performed by Illumina, SOLiD, and Ion Torrent sequencing platforms.

Overview

The FASTQ format has its origins in the FASTA format but extends it by adding a quality score to each nucleotide in the sequence. This quality score represents the error probability of each base call, providing a mechanism for evaluating the accuracy of the sequencing process. The format has become a de facto standard in the field of genomics and bioinformatics for the initial storage and transfer of sequencing data.

Format

A FASTQ file typically uses four lines per sequence. These lines are:

1. The sequence identifier, which begins with a '@' character.
2. The raw sequence letters.
3. A '+' character optionally followed by the same sequence identifier again.
4. The quality score string, which encodes the quality of each nucleotide in the sequence.

The quality scores are encoded using ASCII characters, with the character '!' representing the lowest quality and '~' the highest. The exact mapping of character to quality score varies between sequencing platforms, but a common standard is the Phred quality score, which relates the ASCII character to the error probability logarithmically.

Usage

FASTQ files are extensively used in bioinformatics, especially in tasks involving sequence analysis such as sequence alignment, genome assembly, and variant calling. Tools like FASTQC provide quality control checks on FASTQ files, assessing various metrics to gauge the quality of the sequencing data.

Variants

There are several variants of the FASTQ format, which differ primarily in how they encode the quality scores. The most notable difference is between the encoding schemes used by Illumina 1.3+, Illumina 1.5+, and Sanger sequencing platforms. These differences necessitate careful consideration when processing FASTQ files, as incorrect interpretation of quality scores can lead to erroneous results.

Challenges

Despite its widespread use, the FASTQ format faces criticism for its lack of standardization in certain areas, such as the encoding of quality scores and the representation of metadata. Additionally, the format is not space-efficient, which can be problematic when dealing with the large data volumes generated by modern sequencing technologies.

Conclusion

The FASTQ format is a critical component of the bioinformatics workflow, enabling the storage and analysis of sequencing data. Its simplicity and flexibility have contributed to its widespread adoption, though challenges remain in terms of standardization and data management.