How the Salaf (early generations of Muslims) were re congregational prayer:
Sa`īd Ibn Al Musayyib said, “For twenty years, I have been in the mosque by the time the call to prayer is given.”
Ibn ‘Abbās said: “If somebody hears the call to prayer and does not answer it, he doesn’t want good and good is not wanted for him.” [Ḥilyatu Al Awliyā`].