Modern graphics cards are so bulky that they do regularly sag a bit. It’s important to actually screw the card into the expansion slot on the case, because that adds a bit of support.
Some cases will let you mount your GPU vertically with the help of a riser cable. This distributes the pressure a lot more nicely. Not all cases support a vertical GPU configuration though.