What about using a smaller size needles?

Pourdmary56,
That is what I did. I went down two sizes of needles.I am on the 4th row of the back patterns. I just started it last night

I think your plan of deduction sounds like it would work. Give it a try.

Well I made a mistake in one of the charts so I frogged it back and started over . I also casted on the stitches on the larger needle to knit them off with the smaller needle so it would be easier to knit it off. I went with a size 7 and 8 needles.

I can't get your pattern to load...
But if you use a smaller needle the sweater will bhecome tighter and lose it's "hand".
You need to knit a swatch, check your gauge then see how much you need to decrease the size. I do thin by finding a sweater that fits and measuring. Then figure out how many stitches and rows you will need to cut down to make it right.
You may need to eliminate one element of the design if it's an allover pattern.
Linda C

Linda C,
It is a mens cabled sweater I have the gauge already I just had to down size the needles to go with the yarn choice to get the gauge right.