Contacts freeze

Once my contacts in phonebook starts to connect with app, then it freezes. I have more than 4000 contacts. Will this impose a problem