Bring potatoes and water to cover to boil in medium saucepan. Reduce heat to low; simmer 10 minutes or until potatoes are fork-tender. Drain well.
Mix oil, vinegar, oregano and thyme in large bowl until well blended. Add warm potatoes; toss to coat. Add tomatoes and capers; toss gently to coat.
Serve immediately or refrigerate until ready to serve.