PRX Part 4: Our Data Strategy In one sentence: we assemble training data from a mix of public and internal datasets, re-caption the images with a VLM, and turn the result into the streamable corpus we trained PRX on. At a high level, the data pipeline looks like this: In the following we will dive into it in detail. 1. Guiding principles A diverse dataset for pre-training The goal was to assemble ...