The walls are intentionally textured for acoustical purposes. Adhesives will stick to the wall, but you need to wipe it down first. Use a damp town to wipe the dust off. If it is in an area where people smoke or near the kitchen, you may want to hit the target area with some grease remover like 409.
One exception: if the wall has the gritty sandy texture mixed with the paint, you may want to give it a light sanding with a hard drywall sponge. Use your jusgement, if the texture kind of hurts when you run your hand across, sand it, if it is smooth (orange peel), you should be fine.