Or go in the complete opposite direction. I am like the people here and go with a 2.8-3.3. In warmer months I go with 3.8. However, there is a group that has good success chucking the giant swimbaits this time of year. Im not one of them, but this is the time of year you see it work for them.
Also, I know you are fishing swimbaits around weeds. I found myself pulling my hair out rigging them weedless. If you can find clean hard bottom you will likely find that a swimbait jig head really works well. That open hook wont get in in the same places as well, but it hook up more often.