After doing some more testing I think the problem might just be that I didn't model the high poly correctly and resulting in weird artifacts showing up in UDK right now. To make matters worse I already smooth the high-poly without any back-up so now I might have to go back and remodel a lot of it. Gah bad work ethic is bad. So right now I'm going to go back and redo the high-poly the rebake everything. I'm also going to learn how to do a proper light map so it doesn't look odd in UDK as well. Going to have to change my goal up to finishing this by this weekend since Finals for school are starting so I won't have as much time to work on this.