The right church to go to is one that matches up with the scriptures.
These were more noble than those in Thessalonica, in that they received the word with all readiness of mind, and searched the scriptures daily, whether those things were so. (Acts 17:11)
Many people, though, choose a church because they feel comfortable there. It is better to go to a church that challenges you to get right with God than to go to one that lets you be comfortable in your sin.
It is better to hear the rebuke of the wise, than for a man to hear the song of fools. (Ecclesiastes 7:5)
A good pastor will speak the truth, even if it means he has to rebuke the church.
Preach the word; be instant in season, out of season; reprove, rebuke, exhort with all longsuffering and doctrine. (2 Timothy 4:2)
A bad pastor will not speak the truth, but will tell the people what they want to hear.
For the time will come when they will not endure sound doctrine; but after their own lusts shall they heap to themselves teachers, having itching ears; And they shall turn away their ears from the truth, and shall be turned unto fables. (2 Timothy 4:3-4)
A good church desires to live in a way that will please the Lord, while a bad church tries to see how worldly they can be and still be call themselves “Christians”.
Teaching us that, denying ungodliness and worldly lusts, we should live soberly, righteously, and godly, in this present world; Looking for that blessed hope, and the glorious appearing of the great God and our Saviour Jesus Christ; Who gave himself for us, that he might redeem us from all iniquity, and purify unto himself a peculiar people, zealous of good works. (Titus 2:12-14)
Another attribute to look for in a church is old fashioned hymn singing, instead of contemporary praise and worship music. The former brings you closer to the Lord, while the latter brings you closer to the world.
Let the word of Christ dwell in you richly in all wisdom; teaching and admonishing one another in psalms and hymns and spiritual songs, singing with grace in your hearts to the Lord. (Colossians 3:16)
A sample of music from our church
And finally, a good church will not sacrifice Godly convictions for the goal of a bigger church. Conforming to the world may make your church bigger, but it will not make your church any better.
Be not deceived: evil communications corrupt good manners. (1 Corinthians 15:33)
At Calvary Baptist Church we don’t claim to be perfect, but we do desire to please the Lord because of all he has done for us.
We love him, because he first loved us. (1 John 4:19)
For ye are bought with a price: therefore glorify God in your body, and in your spirit, which are God's. (1 Corinthians 6:20)