Much has been taught about this passage over the years. One of the main points is to understand that the pastors and teachers mentioned in verse 11 are NOT the ones being equipped to do God's work to build up the Church. The pastors and teachers have the important role of equipping the believers to do that work! These pastors must be like the early apostles mentioned in Acts 6 where they said it was their job to be in the word and spend much time in prayer on behalf of the flock. 2 Timothy 3:16,17 reminds us that the Word of God was meant ultimately to equip God's people to live righteous lives. Thus, studying the Word and teaching it is what the pastors/teachers must do to give the believers the necessary tools they need to live right and accomplish God's work.
Building up the Body of Christ means at least bringing more and more people in to the Body through evangelism. That is one ministry every believer can be involved in one way or another. Another important role is to nurture the new believers and disciple them to be prepared themselves to serve. Building also means helping new believers to learn their spiritual gifts and guide them in finding their place in the body.
Are you being equipped to serve? Are you listening to the preaching and teaching in your local church and spending time in God's Word so you can? Pray for your pastors and teachers and encourage them in their God-given role.