Job Description

Functional role: Senior Observability Engineer
Location: 3 days/week onsite in Iselin, NJ
Duration: 3-6 months


The Role:
Near-term (Months 1-3):
o Build and expand Grafana dashboards integrating data from various systems (StatusGator, ControlUp APIs, etc.) to establish immediate service visibility
o Design and implement alert notification workflows and triage procedures (up/down status, warning thresholds, severity levels, etc.)
o Establish integration between monitoring platforms and our ticketing system (Ivanti) for automated ticket creation and routing
o Define alert handling procedures and escalation paths
Long-term (Strategic): Own the design and implementation of our comprehensive enterprise observability strategy from start to finish, including:
o Defining service level objectives (SLOs) and indicators (SLIs) across the organization
o Architecting metrics, logging, and tracing pipelines
o Establishing alerting frameworks and escalation procedures
o Building monitoring standards and best practices
o Driving cultural shift from reactive to proactive monitoring
o Creating business-relevant metrics and reporting for leadership

Required Qualifications:
Proven experience designing and implementing end-to-end observability solutions at enterprise scale using platforms such as Datadog, Dynatrace, New Relic, Splunk, or similar tools - the specific platform is less important than demonstrated ability to architect and execute complete observability transformations
3+ years of hands-on Grafana experience including:
o Dashboard creation, standards, and best practices
o Alerting configuration and management
o Templating, RBAC, and publishing
o API integration and data ingestion
o Clear runbook and documentation development
OpenTelemetry instrumentation experience (metrics, logs, traces pipelines)
Experience with ITSM platform integrations (ServiceNow, Ivanti, Jira Service Management, etc.) for automated ticketing workflows
Track record of leading observability initiatives for large organizations (1,000+ employees) from inception through full implementation
Experience defining and implementing organization-wide SLOs/SLIs and monitoring strategies
Strong execution focus with demonstrated ability to deliver against milestones and see projects through to completion
Excellent communication skills - ability to explain technical concepts to business leadership and influence organizational change
Demonstrable portfolio of complete observability solutions implemented (not just dashboards - full platform implementations and strategies)
Results-oriented approach with ability to balance tactical wins with strategic vision

Job Tags

Similar Jobs