Skip to content

Resume from suspend fails: Xid 119 (GSP RPC timeout) -> oops in nvEvoDisableVblankSemControl -> Xid 154, hard reset required #1271

Description

@m5r

Environment

  • GPU: NVIDIA GeForce RTX 4070 Ti SUPER (AD103, PCI 01:00.0)
  • Driver: 610.43.03, open kernel modules (Arch Linux package nvidia-open-lts 1:610.43.03-8)
  • Kernel: 6.18.40-2-lts
  • Display: X11, i3wm, one 5K monitor
  • Motherboard: ASUS ROG MAXIMUS Z790 HERO, BIOS 3107 (2025-11-28)
  • Suspend configuration: NVreg_PreserveVideoMemoryAllocations=1 and NVreg_TemporaryFilePath=/var/tmp are set. The services nvidia-suspend.service, nvidia-resume.service, and nvidia-hibernate.service are enabled.
  • Other out-of-tree module: v4l2loopback_dc

Summary

The system did not resume from suspend (S3, "deep"). The GSP did not answer RPC calls. The kernel log shows this sequence:

  1. systemd-sleep received three Xid 119 errors (GSP RPC timeout).
  2. The kernel logged two WARNINGs in the driver power path: nv_restore_user_channels (nv.c:4511) and nv_set_system_power_state (nv.c:4804).
  3. The kernel crashed with a null-pointer oops in nvEvoDisableVblankSemControl. The call path was nvResumeDevEvonvRevokeDeviceFreeDeviceReference.
  4. The driver reported Xid 154 and set the recovery action to PF FLR.

The monitor showed "no signal" after this. The system stayed reachable over the network. A clean shutdown was not possible: systemd-suspend.service died with SIGKILL, and the user session did not stop. I had to force a power-off.

Timeline

  • 01:05:52 — PM: suspend entry (deep)
  • 11:01:04 — resume starts; first Xid 119 (GSP_RM_CONTROL timeout)
  • 11:01:07 — WARNING in nv_restore_user_channels, then WARNING in nv_set_system_power_state
  • 11:01:52 and 11:02:40 — two more Xid 119 (GSP_RM_ALLOC, GSP_RM_CONTROL)
  • 11:02:43 — oops in nvEvoDisableVblankSemControl+0x34 [nvidia_modeset], then Xid 154 (PF FLR)

Frequency

This is the first occurrence. My journals go back to 2026-07-07. They show five good suspend/resume cycles on the same driver and kernel between 2026-07-28 and 2026-08-01, with zero Xid errors.

Log excerpt

Kernel log: Xid errors, WARNINGs, and the oops with full call trace
2026-08-02T11:01:04+02:00 mokhtar-pc kernel: NVRM: Xid (PCI:0000:01:00): 119, pid=2401636, name=systemd-sleep, Timeout after 7s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) sequence 3289812 (0x20800a70 0x0).
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: WARNING: CPU: 13 PID: 2401636 at nvidia/nv.c:4511 nv_restore_user_channels+0x4e/0x1f0 [nvidia]
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: Modules linked in: sg tcp_diag inet_diag rfcomm snd_seq_dummy snd_hrtimer snd_seq nf_conntrack_netlink xt_nat veth bridge stp llc xfrm_user xfrm_algo xt_set ip_set xt_addrtype cmac algif_hash algif_skcipher af_alg bnep xt_connmark xt_conntrack xt_MASQUERADE xt_tcpudp xt_mark nft_compat x_tables tun overlay nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink vfat fat snd_sof_pci_intel_tgl snd_sof_pci_intel_cnl snd_sof_intel_hda_generic soundwire_intel snd_sof_intel_hda_sdw_bpt snd_sof_intel_hda_common snd_soc_hdac_hda snd_sof_intel_hda_mlink intel_rapl_msr snd_sof_intel_hda intel_rapl_common soundwire_cadence snd_sof_pci intel_uncore_frequency snd_sof_xtensa_dsp intel_uncore_frequency_common intel_tcc_cooling snd_sof x86_pkg_temp_thermal ucsi_acpi intel_powerclamp snd_sof_utils tps6598x typec_ucsi snd_soc_acpi_intel_match typec coretemp snd_soc_acpi_intel_sdca_quirks soundwire_generic_allocation roles kvm_intel
2026-08-02T11:01:07+02:00 mokhtar-pc kernel:  snd_soc_acpi soundwire_bus snd_soc_sdca kvm crc8 snd_hda_codec_nvhdmi snd_hda_codec_hdmi snd_soc_avs spi_nor iTCO_wdt irqbypass mei_hdcp mei_pxp intel_pmc_bxt spd5118 snd_soc_hda_codec btusb polyval_clmulni mtd iTCO_vendor_support snd_hda_ext_core ghash_clmulni_intel snd_hda_intel aesni_intel btmtk btrtl rapl snd_hda_codec igc btbcm snd_soc_core intel_cstate eeepc_wmi btintel asus_wmi snd_hda_core ptp platform_profile intel_uncore sparse_keymap wmi_bmof pcspkr pps_core bluetooth snd_compress i2c_i801 snd_intel_dspcfg mei_me ac97_bus i2c_smbus spi_intel_pci snd_intel_sdw_acpi mei snd_pcm_dmaengine spi_intel i2c_mux rfkill intel_pmc_core thunderbolt serial_multi_instantiate mousedev joydev pmt_telemetry pmt_discovery snd_usb_audio pmt_class nzxt_smart2 snd_usbmidi_lib intel_pmc_ssram_telemetry pinctrl_alderlake uas acpi_pad acpi_tad snd_hwdep intel_vsec snd_ump snd_rawmidi usb_storage cdc_acm snd_seq_device mac_hid dm_mod nvidia_drm(OE) nvme nvidia_modeset(OE) nvme_core nvme_keyring video intel_lpss_pci
2026-08-02T11:01:07+02:00 mokhtar-pc kernel:  nvme_auth intel_lpss drm_ttm_helper ttm hkdf idma64 vmd wmi nvidia_uvm(OE) nvidia(OE) snd_aloop v4l2loopback_dc(OE) snd_pcm snd_timer videodev snd mc i2c_dev soundcore pkcs8_key_parser crypto_user
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: CPU: 13 UID: 0 PID: 2401636 Comm: systemd-sleep Tainted: G           OE       6.18.40-2-lts #1 PREEMPT(voluntary)  34ea2b7296cec769dfe80dfbbdbb03bd63a84064
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: Hardware name: ASUS System Product Name/ROG MAXIMUS Z790 HERO, BIOS 3107 11/28/2025
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: WARNING: CPU: 13 PID: 2401636 at nvidia/nv.c:4804 nv_set_system_power_state.part.0+0x455/0x5f0 [nvidia]
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: Modules linked in: sg tcp_diag inet_diag rfcomm snd_seq_dummy snd_hrtimer snd_seq nf_conntrack_netlink xt_nat veth bridge stp llc xfrm_user xfrm_algo xt_set ip_set xt_addrtype cmac algif_hash algif_skcipher af_alg bnep xt_connmark xt_conntrack xt_MASQUERADE xt_tcpudp xt_mark nft_compat x_tables tun overlay nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink vfat fat snd_sof_pci_intel_tgl snd_sof_pci_intel_cnl snd_sof_intel_hda_generic soundwire_intel snd_sof_intel_hda_sdw_bpt snd_sof_intel_hda_common snd_soc_hdac_hda snd_sof_intel_hda_mlink intel_rapl_msr snd_sof_intel_hda intel_rapl_common soundwire_cadence snd_sof_pci intel_uncore_frequency snd_sof_xtensa_dsp intel_uncore_frequency_common intel_tcc_cooling snd_sof x86_pkg_temp_thermal ucsi_acpi intel_powerclamp snd_sof_utils tps6598x typec_ucsi snd_soc_acpi_intel_match typec coretemp snd_soc_acpi_intel_sdca_quirks soundwire_generic_allocation roles kvm_intel
2026-08-02T11:01:07+02:00 mokhtar-pc kernel:  snd_soc_acpi soundwire_bus snd_soc_sdca kvm crc8 snd_hda_codec_nvhdmi snd_hda_codec_hdmi snd_soc_avs spi_nor iTCO_wdt irqbypass mei_hdcp mei_pxp intel_pmc_bxt spd5118 snd_soc_hda_codec btusb polyval_clmulni mtd iTCO_vendor_support snd_hda_ext_core ghash_clmulni_intel snd_hda_intel aesni_intel btmtk btrtl rapl snd_hda_codec igc btbcm snd_soc_core intel_cstate eeepc_wmi btintel asus_wmi snd_hda_core ptp platform_profile intel_uncore sparse_keymap wmi_bmof pcspkr pps_core bluetooth snd_compress i2c_i801 snd_intel_dspcfg mei_me ac97_bus i2c_smbus spi_intel_pci snd_intel_sdw_acpi mei snd_pcm_dmaengine spi_intel i2c_mux rfkill intel_pmc_core thunderbolt serial_multi_instantiate mousedev joydev pmt_telemetry pmt_discovery snd_usb_audio pmt_class nzxt_smart2 snd_usbmidi_lib intel_pmc_ssram_telemetry pinctrl_alderlake uas acpi_pad acpi_tad snd_hwdep intel_vsec snd_ump snd_rawmidi usb_storage cdc_acm snd_seq_device mac_hid dm_mod nvidia_drm(OE) nvme nvidia_modeset(OE) nvme_core nvme_keyring video intel_lpss_pci
2026-08-02T11:01:07+02:00 mokhtar-pc kernel:  nvme_auth intel_lpss drm_ttm_helper ttm hkdf idma64 vmd wmi nvidia_uvm(OE) nvidia(OE) snd_aloop v4l2loopback_dc(OE) snd_pcm snd_timer videodev snd mc i2c_dev soundcore pkcs8_key_parser crypto_user
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: CPU: 13 UID: 0 PID: 2401636 Comm: systemd-sleep Tainted: G        W  OE       6.18.40-2-lts #1 PREEMPT(voluntary)  34ea2b7296cec769dfe80dfbbdbb03bd63a84064
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: Tainted: [W]=WARN, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
2026-08-02T11:01:07+02:00 mokhtar-pc kernel: Hardware name: ASUS System Product Name/ROG MAXIMUS Z790 HERO, BIOS 3107 11/28/2025
2026-08-02T11:01:52+02:00 mokhtar-pc kernel: NVRM: Xid (PCI:0000:01:00): 119, pid=2401636, name=systemd-sleep, Timeout after 6s of waiting for RPC response from GPU0 GSP! Expected function 103 (GSP_RM_ALLOC) sequence 3289814 (0x20800a70 0x0).
2026-08-02T11:02:40+02:00 mokhtar-pc kernel: NVRM: Xid (PCI:0000:01:00): 119, pid=2401636, name=systemd-sleep, Timeout after 6s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) sequence 3289816 (0x20800a70 0x0).
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: NVRM: Xid (PCI:0000:01:00): 154, GPU recovery action changed from 0x0 (None) to 0x1 (PF FLR)
[...]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: BUG: unable to handle page fault for address: 00000000000025f0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: #PF: supervisor read access in kernel mode
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: #PF: error_code(0x0000) - not-present page
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: PGD 0 P4D 0 
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: Oops: Oops: 0000 [#1] SMP NOPTI
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: CPU: 13 UID: 0 PID: 2401636 Comm: systemd-sleep Tainted: G        W  OE       6.18.40-2-lts #1 PREEMPT(voluntary)  34ea2b7296cec769dfe80dfbbdbb03bd63a84064
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: Tainted: [W]=WARN, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: Hardware name: ASUS System Product Name/ROG MAXIMUS Z790 HERO, BIOS 3107 11/28/2025
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: RIP: 0010:nvEvoDisableVblankSemControl+0x34/0xd0 [nvidia_modeset]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: Code: 56 41 55 41 54 49 89 f4 55 53 48 8d 5e 10 48 83 ec 08 8b 06 4c 8b b4 c7 c8 02 00 00 49 8d ae 18 26 00 00 4d 8d ae 18 27 00 00 <48> 8b 55 d8 48 8b 43 20 8b 08 48 89 50 10 f0 48 83 0c 24 00 89 48
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: RSP: 0018:ffffce0243fcf650 EFLAGS: 00010286
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: RAX: 0000000000000000 RBX: ffff8a4166399ed8 RCX: ffff8a4166399ec8
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: RDX: 0000000000000000 RSI: ffff8a4166399ec8 RDI: ffffce0240ed9008
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: RBP: 0000000000002618 R08: ffff8a3b02bd41f0 R09: ffffce0243fcf69c
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: R10: ffff8a38d0d54000 R11: ffff8a38c0042d00 R12: ffff8a4166399ec8
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: R13: 0000000000002718 R14: 0000000000000000 R15: ffffce0240ed9008
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: FS:  00007fdf8e0a0c80(0000) GS:ffff8a48dc0fa000(0000) knlGS:0000000000000000
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: CR2: 00000000000025f0 CR3: 00000001ebbc1005 CR4: 0000000000f72ef0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: PKRU: 00000000
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: Call Trace:
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  <TASK>
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  FreeDeviceReference+0x70/0x1a0 [nvidia_modeset 2d855566cf6f17c37d6694be7e1d8c8678ed08a0]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  nvRevokeDevice+0x8c/0x90 [nvidia_modeset 2d855566cf6f17c37d6694be7e1d8c8678ed08a0]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  FreeDeviceReference+0x187/0x1a0 [nvidia_modeset 2d855566cf6f17c37d6694be7e1d8c8678ed08a0]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? console_unlock+0x90/0x120
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  nvRevokeDevice+0x8c/0x90 [nvidia_modeset 2d855566cf6f17c37d6694be7e1d8c8678ed08a0]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  nvResumeDevEvo+0x125/0x240 [nvidia_modeset 2d855566cf6f17c37d6694be7e1d8c8678ed08a0]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? _printk+0x6b/0x90
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  nvKmsResume+0x5c/0xd0 [nvidia_modeset 2d855566cf6f17c37d6694be7e1d8c8678ed08a0]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? down+0x1e/0x70
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  nvkms_resume+0x1f/0x50 [nvidia_modeset 2d855566cf6f17c37d6694be7e1d8c8678ed08a0]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  nv_set_system_power_state.part.0+0x11c/0x5f0 [nvidia ead25622ec28a510dda9ee6bdcb752e65cc6eab5]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? scx_bypass+0xf0/0x2c0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  nv_pm_notifier+0x35/0xa0 [nvidia ead25622ec28a510dda9ee6bdcb752e65cc6eab5]
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  notifier_call_chain+0x6f/0x100
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  blocking_notifier_call_chain+0x40/0x60
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  pm_suspend.cold+0x2cb/0x35c
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  state_store+0x84/0x100
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  kernfs_fop_write_iter+0x171/0x220
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  vfs_write+0x281/0x570
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ksys_write+0x7b/0x110
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  do_syscall_64+0x83/0x820
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? prep_new_page+0xd3/0x1e0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? get_page_from_freelist+0x3f0/0x1cd0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? audit_reset_context+0x2c1/0x330
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? __audit_syscall_exit+0xa1/0x100
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? __alloc_frozen_pages_noprof+0x199/0x380
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? mod_memcg_lruvec_state+0xc5/0x1f0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? __lruvec_stat_mod_folio+0x85/0xd0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? __folio_mod_stat+0x2d/0x90
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? folio_add_new_anon_rmap+0x73/0x1c0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? do_anonymous_page+0x687/0x9d0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? ___pte_offset_map+0x1b/0x160
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? __handle_mm_fault+0xa5c/0xf10
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? count_memcg_events+0xc2/0x190
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? handle_mm_fault+0x1d7/0x2b0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? do_user_addr_fault+0x23b/0x730
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  ? exc_page_fault+0x8f/0x1d0
2026-08-02T11:02:43+02:00 mokhtar-pc kernel:  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: RIP: 0033:0x7fdf8d6948de
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: Code: 4d 89 d8 e8 84 bf 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 <c9> c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa
2026-08-02T11:02:43+02:00 mokhtar-pc kernel: RSP: 002b:00007fffc220ae00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001

I sent the full nvidia-bug-report.gz to linux-bugs@nvidia.com with a link to this issue. I can post the full kernel log of the failure window here on request.

Possibly related: #1125. That report shows a GSP timeout on resume with the open modules. Its reporter states that the proprietary driver of the same version does not show the problem.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions