Does profiling slow down my site?

No. Instrumentation only attaches during actual cron dispatches, so normal front-end and admin page loads carry zero profiling overhead. During cron, each task adds one insert and one update — negligible next to the task itself.