Place rack in the upper third of oven and preheat over to 400 degrees F. On a rimmed baking sheet, toss the cauliflower with 2 tablespoons olive oil, salt, and pepper. Roast until tender, 15 to 25 minutes, shaking the pan once halfway through. Remove from oven and toss with the capers.