No tree is perfect for every location. The red maples are not quite as fast growing, but they also have less breakage and usually better fall color if you get the cultivated varieties.

The freeman hybrids are indeed fast growing, and there is a slightly higher chance of breakage. If you prune branches that make tight V's, you can practically eliminate this problem.

Both have fairly vigorous fibrous surface roots that could eventually damage sidewalks and structures nearby, and the straight red maple is probably better suited for these spots. This can also cause some problems for water loving underplantings, but with proper irrigation and mulching it can usually be overcome.

Aphids and insects do feed on these maples occasionally, but rarely do insects doing significant damage. Leafhoppers are probably the only one that should be controlled, but ambrosia beetle can be devastating to almost all trees primarily when young and when in nursery conditions. Fungi such as verticilium wilt and to a lesser extent root rot are more problematic. These conditions are still unusual and are usually induced by poor culture. Anthracnose and a few foliar fungi can cause some leaf damage but rarely damage maples signficantly, unlike dogwoods.

Overall they are one of the best (top 5) mid to large shade trees IMO. Compared to many others they are tough trees that combine several desirable characteristics while minimizing the undesirables.