The finish swivel may very likely be the source of your grief.
Mr. Kelley put it this way:
"The weak and timid slice tendency of the underswivel is more prevalent than overswivelling with its draw tendency. But the correct swivel is strong, complete, smooth and rhythmic and leads to full power."