How about a kumquat?

Here is a link that might be useful: What is a kumquat

Thanks for the suggestion but it isn't a kumquat. I have raised kumquats. This fruit has the surface texture of a nectarine and has one large marble-sized fruit inside.

Yes, not a citrus.

I think it is Ximenia americana, hog plum.

Here is a link that might be useful: Ximenia americana, hog plum

It does look like the Hog Plum described by Susanc, look at the following info. If that matches, especially the smell of the crushed leaves, then it is most likely is ximenia americana. If not, then it could be one of the wild plums native to Florida.

Leaves are oval shaped, bright green and have a strong smell of almonds. Flowers are pale in color. Fruits are lemon-yellow or orange-red.