To me it looks like blight. Are you spraying your plants with anything? Cut off all affected leaves ASAP and dispose of them in the trash. If you aren't spraying you need to get a fungicide. I've had moderate success with Daconil but toward the end of the season my plants are usually toast.

Not sure what it is, but doesn't seem to be blight to me. Late blight goes for the new growth, and early blight is identifiable by the concentric ring lesions. How old is the plant? It is not abnormal for old growth to turn yellow/brown on old plants, though it may indicate some kind of pathogen.

The plant had some aphids so I sprayed them with dishwater, I think I might of used more Soap then I should have. I stopped spraying and it doesn’t seem to be spreading.

I have a hunch. You mention spraying for aphids with 'dishwater'. Did you use a liquid detergent soap in the dishwater? If so, read the label, Do you see the word 'antibacterial'? That could be your problem. Only organic soaps should be used in plant sprays. METHOD dishwashing liquid is organic and can be used for horticultural sprays.

Fungicides (including soaps) really are preventatives, not cures. Once the fungal hyphae penetrate the leaves, it's all over. But treating to prevent spread should work. By all means remove the affected leaves.