Anchor areas are provided that are engaged by swelling of a swellable element of a downhole tool. When engaged with an open hole or casing, the anchor areas provide additional holding power for the swellable element. The anchor areas may be formed as separate elements disposed about the swellable element or may be formed into the surface of the swellable element.