Break-fix Scenario

A RHEL9 server is running Red Hat Satellite 6.17 but hammer ping command shows candlepin failure. Your job is to investigate the issue and ensure that hammer ping does not show FAIL for any of the services.

Here is error the message:

[lab-user@bastion ~]$ sudo ssh satellite
[cloud-user@satellite ~]$ sudo su -
[root@satellite ~]# hammer ping
...
candlepin:
    Status:          FAIL
    Server Response: Message: Failed to open TCP connection to localhost:23443 (Connection refused - connect(2) for "localhost" port 23443)
candlepin_auth:
    Status:          FAIL
    Server Response: Message: A backend service [ Candlepin ] is unreachable
candlepin_events:
    Status:          FAIL
    message:         Not running
    Server Response: Duration: 0ms
...

Objectives

Investigate why the candlepin & tomcat services are down in hammer ping .
Solve the candlepin issue in the hands-on lab environment.

Recreate Scenario

To recreate this scenario, run the lab script on the bastion server.

[lab-user@bastion ~]$ lab break breakfix0
Initiating /usr/local/bin/lab with option(s) break breakfix0
Completed /usr/local/bin/lab with option(s) break breakfix0 successfully

It may take 2-3 minutes to complete.

Success Criteria

Ensure the hammer ping command results in ok for all the listed services including candlepin.

[lab-user@bastion ~]$ sudo ssh satellite
[cloud-user@satellite ~]$ sudo su -
[root@satellite ~]# hammer ping
...
candlepin:
    Status:          ok
    Server Response: Duration: 21ms
candlepin_auth:
    Status:          ok
    Server Response: Duration: 16ms
candlepin_events:
    Status:          ok
    message:         32 Processed, 0 Failed
    Server Response: Duration: 0ms
...