He joins heartily in the singing, which is congregational.

My father joins heartily in this prayer, with

I noticed careful attention being given to the public reading of the Scriptures, and the congregation joins heartily in the singing.

He therefore joins heartily in the hymn which is sung by the congregation of the little chapel at the close of their worship.