We present a study of the galaxy environment of nine strong H I + C IV absorption line systems (16.2 < log(N(HI)) < 21.2) spanning a wide range in metallicity at z ∼ 4-5, using MUSE integral field and X-Shooter spectroscopic data collected in a z ≍ 5.26 quasar field. We identify galaxies within a 250 kpc and ±1000 km s^-1 window for six out of the nine absorption systems, with two of the absorption line systems showing multiple associated galaxies within the MUSE field of view. The space density of Ly α emitting galaxies (LAEs) around the H I and C IV systems is ≍10-20 times the average sky density of LAEs given the flux limit of our survey, showing a clear correlation between the absorption and galaxy populations. Further, we find that the strongest C IV systems in our sample are those that are most closely aligned with galaxies in velocity space, I.e. within velocities of ±500 km s^-1. The two most metal-poor systems lie in the most dense galaxy environments, implying we are potentially tracing gas that is infalling for the first time into star-forming groups at high redshift. Finally, we detect an extended Ly α nebula around the z ≍ 5.26 quasar, which extends up to ≍50 kpc at the surface brightness limit of 3.8 × 10^-18 erg s^-1 cm^-2 arcsec^-2. After scaling for surface brightness dimming, we find that this nebula is centrally brighter, having a steeper radial profile than the average for nebulae studied at z ∼ 3 and is consistent with the mild redshift evolution seen from z ≍ 2.