What graphics card are you using? If it's not 1 that supports CUDA you can trick Premiere Pro into thinking your graphics card supports CUDA:
Go to C:\Program Files\Adobe\Adobe Premiere Pro CS6 and find the .txt file labeled "cuda_supported_cards" and rename it to "cuda_supported_cards BACKUP". You should be able to do 2 pass encoding 1080P h.264 a lot faster.
If you have your stuff installed in a different location just search explorer for "cuda_supported_cards" and rename it as a I said. Once you've done that when you go back into Premiere Pro Cs6 make sure you go to menu up the top and select Project > Project Settings > General and make sure "Mecury Playback Engine GPU Acceleration (CUDA)" is selected as the Renderer. You might need to start a new project because sometimes older projects using the non-CUDA version gets stuck. This has helped me with export times significantly. I've had videos that took up to 7hrs or more just cause of text I added to the video, normally you'll notice longer export times if there's red bars above the timeline. If it's all yellow, which it should be after the CUDA hack, then export times are generally quicker. Now a 20min video takes me about 20-30mins to export. At maximum the longest anything has taken to export me is 1hr but that's on rare occasion when I use any special effects that isn't text.
Another thing you can do is enable the option that says "Use Previews" at the bottom of the export settings but I've found that using previews can cause some degrade in quality sometimes, primarily when special effects are used or if text is used. You want 2 pass encoding cause it can produce better quality, sometimes the difference between 2 pass vs 1 isn't noticable. You can try CBR too, which is constant bitrate and faster than the other 2 but again higher chance of reduced quality.