Arrays of neutral atoms present a promising system for quantum computing, quantum sensors, and other applications, several of which would profit from the ability to load, cool, and image the atoms in a finite magnetic field. In this work, we develop a technique to image and prepare $^{87} atom arrays in a finite magnetic field by combining EIT cooling with fluorescence imaging. We achieve an average readout fidelity of 9.7(1)\,\%$ at 8.2(3)\,\%$ survival probability and up to 8(2)\%$ single-atom stochastic loading probability in a 2.3 G magnetic field, with performance validated at fields up to 10 G. We further develop a model to predict the survival probability, which also agrees well with several other atom array experiments. Our technique cools both the axial and radial directions, and will enable future continuously-operated neutral atom quantum processors and quantum sensors.