...
vRNI services stopvRNI stops collecting data and cannot access GUIvRNI services do not startWhen you run the (cli) show-service-status command, you see similar output when vRNI is not in sync with NTP: ElasticSearch is running HMaster is running HRegionServer is running Kafka is running QuorumPeerMain is running ResourceManager is running NodeManager is running Problem: SaasListener javaservice is not running. Problem: Restapilayer javaservice is not running. Problem: ClusterBasedJobCoordinator javaservice is not running. Problem: SamzaContainer javaservice is not running. Problem: Launcher javaservice is not running. Postgresql is running Problem: Nginx service is not running. Patroni is running ExpressJSApp is running NTP is running but not healthy.
From vRNI version 3.5, the deployment setup must be IN SYNC with the configured NTP. If some of the components cannot reach NTP or go OUT Of SYNC, the services stop and cannot be started.
Sample TCPDUMP output of working vs non-working setup: Ensure that connectivity to NTP Server is working. NTP server is connected on UDP Port 123. Verify the NTP configuration by running this command: (cli) show-config You see output similar to: network configurations: IP Address: 192.168.1.100 Netmask: 255.255.255.0 Gateway: 192.168.1.1 DNS nameservers: 192.168.1.1 192.168.1.2 Domain Search list: example.com NTP servers: time.google.com If any change is required in NTP configuration, perform these steps: Log in to Platform / Proxy as consoleuser.Run this command:. (cli) setup You see output similar to: Running setup: Interactive Mode. Warning!!!: Only selective configuration can be changed (y/n):y ovaops: configure deployed state Currently IP_Address = 192.168.1.100 , keep this (y/n)? [ y ]: y Currently Netmask = 255.255.255.0 , keep this (y/n)? [ y ]: y Currently Default_Gateway = 192.168.1.1 , keep this (y/n)? [ y ]: y Currently DNS = 192.168.1.1 192.168.1.2 , keep this (y/n)? [ y ]: y Currently Domain_Search = example.com , keep this (y/n)? [ y ]: y Currently NTP = time.google.com , keep this (y/n)? [ y ]: n Enter new NTP (e.g. 0.us.pool.ntp.org 192.168.0.5): time.example.com Currently Web_Proxy_IP = [None] , keep this (y/n)? [ y ]: y Currently Web_Proxy_Port = [None] , keep this (y/n)? [ y ]: y Currently Enable_Telemetry = [None] , keep this (y/n)? [ y ]: y ----------------------------------- Received below values: ----------------------------------- IP_Address = 192.168.1.100 Netmask = 255.255.255.0 Default_Gateway = 192.168.1. DNS = 192.168.1.1 192.168.1.2 Domain_Search = example.com NTP = time.example.com Web_Proxy_IP = [None] Web_Proxy_Port = [None] Enable_Telemetry = [None] Configure and save configuration (y/n) [ y ]: y It will take few seconds.... New IP Address is the same as old IP address. ovaops: Configuring nginx ovaops: nginx configured and restarted ovaops: PASSED ovaops: verify deployed state ovaops: PASSED vRNI-monitor-ntp: vRNI appliance found initialized and ntp INSYNC Restarting services... Verifying services are up, it may take some time... Verify restapilayer verified running... Verify yarn containers verified running... Troubleshooting NTP Sync issues: Log in to vRNI (Platform/Proxy) as a Support user.Run this command: support@vrni-platform-release:~$ ntpq -np You see output similar to: Scenario1: NTP IN SYNC [Working] remote refid st t when poll reach delay offset jitter ============================================================================== *10.113.60.176 10.16.74.11 2 u 25 64 377 34.287 -6.555 9.710 support@vrni-platform-release:~$ sudo tcpdump -p -i eth0 udp port 123 tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes 09:50:55.957551 IP xx.xx.53.134.ntp > scrootdc02.vmware.com.ntp: NTPv4, Client, length 48 09:50:55.993224 IP scrootdc02.vmware.com.ntp > xx.xx.53.134.ntp: NTPv3, Server, length 48 09:50:57.957546 IP xx.xx.53.134.ntp > scrootdc02.vmware.com.ntp: NTPv4, Client, length 48 09:50:57.992278 IP scrootdc02.vmware.com.ntp > xx.xx.53.134.ntp: NTPv3, Server, length 48 09:50:59.957528 IP xx.xx.53.134.ntp > scrootdc02.vmware.com.ntp: NTPv4, Client, length 48 09:50:59.992078 IP scrootdc02.vmware.com.ntp > xx.xx.53.134.ntp: NTPv3, Server, length 48 Scenario2: NTP NOT IN SYNC [Not Working] remote refid st t when poll reach delay offset jitter ============================================================================== 216.239.35.4 .INIT. 16 u - 64 0 0.000 0.000 0.000 Upon running tcpdump: No packets/response are coming from ntp server. support@vrni-platform-release:~$ sudo tcpdump -p -i eth0 udp port 123 tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes 09:54:30.032549 IP 192.168.1.100.ntp > pugot.canonical.com.ntp: NTPv4, Client, length 48 09:55:35.032471 IP 192.168.1.100.ntp > pugot.canonical.com.ntp: NTPv4, Client, length 48 09:56:40.032483 IP 192.168.1.100.ntp > pugot.canonical.com.ntp: NTPv4, Client, length 48