Skip to content

winget list running slow possible issue with "Opened SQLite Index with version" #4901

Open
@marekciel

Description

Brief description of your issue

winget list is runing very slow on the newly installed machine. It was working correctly but after couple of reboots winget stoped responding.

I can also see the same slownes behavior when ussing import and upgrade commands (although I have only tried on thoes)

Steps to reproduce

winget list

Expected behavior

To finish get list in a matter of seconds.

Actual behavior

When trying to list packages it take for ever to do so.

2024-10-24 15:05:24.362 [CORE] Package: Microsoft.DesktopAppInstaller v1.23.1911.0
2024-10-24 15:05:24.362 [CORE] IsCOMCall:0; Caller: winget-cli
2024-10-24 15:05:24.369 [CLI ] WinGet invoked with arguments: 'list' '--verbose-logs'
2024-10-24 15:05:24.369 [CLI ] Found subcommand: list
2024-10-24 15:05:24.371 [CLI ] Leaf command to execute: root:list
2024-10-24 15:05:24.372 [CORE] Setting action: Get, Type: Secure, Name: admin_settings
2024-10-24 15:05:24.372 [CORE] Admin settings was not found
2024-10-24 15:05:24.372 [CORE] Setting action: Get, Type: Secure, Name: admin_settings
2024-10-24 15:05:24.372 [CORE] Admin settings was not found
2024-10-24 15:05:24.372 [CLI ] Executing command: list
2024-10-24 15:05:24.372 [REPO] Additional sources GP is not enabled.
2024-10-24 15:05:24.372 [CORE] Setting action: Get, Type: Secure, Name: user_sources
2024-10-24 15:05:24.372 [CORE] Setting action: Get, Type: Secure, Name: admin_settings
2024-10-24 15:05:24.372 [CORE] Admin settings was not found
2024-10-24 15:05:24.373 [CORE] Adding chain to pinning configuration [Microsoft Store Source]:
DigiCert Global Root G3 : PublicKey
  Microsoft Azure ECC TLS Issuing CA 04 : Subject | Issuer
    sfdataservice.microsoft.com : Subject | Issuer
2024-10-24 15:05:24.373 [CORE] Adding chain to pinning configuration [Microsoft Store Source]:
DigiCert Global Root G3 : PublicKey
  Microsoft Azure ECC TLS Issuing CA 04 : Subject | Issuer
    sfdataservice.microsoft.com : Subject | Issuer
2024-10-24 15:05:24.378 [CORE] Setting action: Get, Type: Standard, Name: sources_metadata
2024-10-24 15:05:24.378 [YAML] Detected UTF-8
2024-10-24 15:05:24.378 [REPO] GetCurrentSourceRefs: Source named 'microsoft.builtin.desktop.frameworks' from origin Default is hidden and is dropped.
2024-10-24 15:05:24.378 [REPO] Default source requested, multiple sources available, adding all to source references.
2024-10-24 15:05:24.378 [REPO] Adding to source references msstore
2024-10-24 15:05:24.379 [CORE] Setting action: Get, Type: Secure, Name: admin_settings
2024-10-24 15:05:24.379 [CORE] Admin settings was not found
2024-10-24 15:05:24.379 [CORE] Default proxy is not set
2024-10-24 15:05:24.379 [REPO] REST HTTP Client helper does not use proxy
2024-10-24 15:05:24.379 [REPO] Adding to source references winget
2024-10-24 15:05:24.379 [CLI ] Created authentication arguments. Mode: silentPreferred, Account: 
2024-10-24 15:05:24.388 [CORE] Examining extension: PFN = Microsoft.Winget.Source_8wekyb3d8bbwe, ID = IndexDB
2024-10-24 15:05:24.388 [CORE] Found matching extension.
2024-10-24 15:05:24.391 [REPO] Source `winget` after auto update time [15 mins]; it has been at least 19 mins
2024-10-24 15:05:24.396 [CORE] Examining extension: PFN = Microsoft.Winget.Source_8wekyb3d8bbwe, ID = IndexDB
2024-10-24 15:05:24.396 [CORE] Found matching extension.
2024-10-24 15:05:24.398 [CORE] Retrieving headers from url: https://cdn.winget.microsoft.com/cache/source2.msix
2024-10-24 15:05:24.834 [REPO] Header indicates version is: 2024.1024.1221.1
2024-10-24 15:05:24.834 [REPO] Remote source data (2024.1024.1221.1) was not newer than existing (2024.1024.1221.1), no update needed
2024-10-24 15:05:24.834 [REPO] Additional sources GP is not enabled.
2024-10-24 15:05:24.834 [CORE] Setting action: Get, Type: Secure, Name: user_sources
2024-10-24 15:05:24.834 [CORE] Setting action: Get, Type: Secure, Name: admin_settings
2024-10-24 15:05:24.834 [CORE] Admin settings was not found
2024-10-24 15:05:24.834 [CORE] Adding chain to pinning configuration [Microsoft Store Source]:
DigiCert Global Root G3 : PublicKey
  Microsoft Azure ECC TLS Issuing CA 04 : Subject | Issuer
    sfdataservice.microsoft.com : Subject | Issuer
2024-10-24 15:05:24.834 [CORE] Adding chain to pinning configuration [Microsoft Store Source]:
DigiCert Global Root G3 : PublicKey
  Microsoft Azure ECC TLS Issuing CA 04 : Subject | Issuer
    sfdataservice.microsoft.com : Subject | Issuer
2024-10-24 15:05:24.835 [CORE] Setting action: Get, Type: Standard, Name: sources_metadata
2024-10-24 15:05:24.835 [YAML] Detected UTF-8
2024-10-24 15:05:24.835 [CORE] Setting action: Set, Type: Standard, Name: sources_metadata
2024-10-24 15:05:24.835 [REPO] Multiple sources available, creating aggregated source.
2024-10-24 15:05:24.835 [REPO] Adding to aggregated source: msstore
2024-10-24 15:05:24.835 [REPO] User agent caller found: winget-cli
2024-10-24 15:05:24.835 [REPO] Sending http GET request to: https://storeedgefd.dsx.mp.microsoft.com/v9.0/information
2024-10-24 15:05:24.837 [REPO] Http GET request details:
GET / HTTP/1.1

Content-Type: application/json

User-Agent: winget-cli WindowsPackageManager/1.8.1911 DesktopAppInstaller/Microsoft.DesktopAppInstaller v1.23.1911.0




2024-10-24 15:05:25.359 [REPO] Response status: 200
2024-10-24 15:05:25.359 [REPO] Response details:
HTTP/1.1 200 OK

Cache-Control: max-age=0, no-cache, no-store

Connection: keep-alive

Content-Length: 861

Content-Type: application/json; charset=utf-8

Date: Thu, 24 Oct 2024 13:05:25 GMT

Expires: Thu, 24 Oct 2024 13:05:25 GMT

MS-CV: o9JImZEujU2dDq/e.0

Pragma: no-cache

Server: Microsoft-HTTPAPI/2.0

X-OSG-Served-By: Torus-WESTEUROPE_Legacy000M54_1.0.0.0

X-Segment-On: true



{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageMetadata.PackageMetadataResponse, StoreEdgeFD","Data":{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageMetadata.PackageMetadataData, StoreEdgeFD","SourceIdentifier":"StoreEdgeFD","SourceAgreements":{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageMetadata.SourceAgreements, StoreEdgeFD","AgreementsIdentifier":"StoreEdgeFD","Agreements":[{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageManifest.AgreementDetail, StoreEdgeFD","AgreementLabel":"Terms of Transaction","AgreementUrl":"https://aka.ms/microsoft-store-terms-of-transaction"}]},"ServerSupportedVersions":["1.0.0","1.1.0","1.6.0"],"RequiredQueryParameters":["market"],"RequiredPackageMatchFields":["market"]}}
2024-10-24 15:05:25.359 [REPO] Authentication node not found. Assuming authentication type none.
2024-10-24 15:05:25.359 [REPO] User agent caller found: winget-cli
2024-10-24 15:05:25.359 [REPO] Sending http GET request to: https://storeedgefd.dsx.mp.microsoft.com/v9.0/information
2024-10-24 15:05:25.359 [REPO] Http GET request details:
GET / HTTP/1.1

Content-Type: application/json

User-Agent: winget-cli WindowsPackageManager/1.8.1911 DesktopAppInstaller/Microsoft.DesktopAppInstaller v1.23.1911.0




2024-10-24 15:05:25.436 [REPO] Response status: 200
2024-10-24 15:05:25.437 [REPO] Response details:
HTTP/1.1 200 OK

Cache-Control: max-age=0, no-cache, no-store

Connection: keep-alive

Content-Length: 861

Content-Type: application/json; charset=utf-8

Date: Thu, 24 Oct 2024 13:05:25 GMT

Expires: Thu, 24 Oct 2024 13:05:25 GMT

MS-CV: o9JImZEujU2dDq/e.0

Pragma: no-cache

Server: Microsoft-HTTPAPI/2.0

X-OSG-Served-By: Torus-WESTEUROPE_Legacy000M54_1.0.0.0

X-Segment-On: true



{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageMetadata.PackageMetadataResponse, StoreEdgeFD","Data":{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageMetadata.PackageMetadataData, StoreEdgeFD","SourceIdentifier":"StoreEdgeFD","SourceAgreements":{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageMetadata.SourceAgreements, StoreEdgeFD","AgreementsIdentifier":"StoreEdgeFD","Agreements":[{"$type":"Microsoft.Marketplace.Storefront.StoreEdgeFD.BusinessLogic.Response.PackageManifest.AgreementDetail, StoreEdgeFD","AgreementLabel":"Terms of Transaction","AgreementUrl":"https://aka.ms/microsoft-store-terms-of-transaction"}]},"ServerSupportedVersions":["1.0.0","1.1.0","1.6.0"],"RequiredQueryParameters":["market"],"RequiredPackageMatchFields":["market"]}}
2024-10-24 15:05:25.437 [REPO] Authentication node not found. Assuming authentication type none.
2024-10-24 15:05:25.437 [REPO] Adding to aggregated source: winget
2024-10-24 15:05:25.468 [CORE] Examining extension: PFN = Microsoft.Winget.Source_8wekyb3d8bbwe, ID = IndexDB
2024-10-24 15:05:25.469 [CORE] Found matching extension.
2024-10-24 15:05:25.510 [REPO] Opening database for ImmutableRead at 'C:\Program Files\WindowsApps\Microsoft.Winget.Source_2024.1024.1221.1_neutral__8wekyb3d8bbwe\Public\index.db'
2024-10-24 15:05:25.511 [REPO] Opened SQLite Index with version [2.0], last write [2024-10-24 13:20:25.000]
2024-10-24 15:06:38.795 [CLI ] Checking Source agreements for source: msstore
2024-10-24 15:06:38.796 [REPO] Additional sources GP is not enabled.
2024-10-24 15:06:38.796 [CORE] Setting action: Get, Type: Secure, Name: user_sources
2024-10-24 15:06:38.796 [CORE] Setting action: Get, Type: Secure, Name: admin_settings
2024-10-24 15:06:38.796 [CORE] Admin settings was not found
2024-10-24 15:06:38.796 [CORE] Adding chain to pinning configuration [Microsoft Store Source]:

It looks like every time it tries to Opened SQLite Index with version it takes a minute to move on. This happens everytime this is needed:

2024-10-24 15:05:25.511 [REPO] Opened SQLite Index with version [2.0], last write [2024-10-24 13:20:25.000]
2024-10-24 15:06:38.795 [CLI ] Checking Source agreements for source: msstore

2024-10-24 15:07:17.190 [REPO] Opened SQLite Index with version [1.7], last write [2024-10-24 13:20:04.000]
2024-10-24 15:07:53.886 [REPO] Performing search: Query:[none] Include:ProductCode='27a75bf3-be48-5c35-934f-8491cf108abe'

2024-10-24 15:07:53.895 [REPO] Opened SQLite Index with version [1.7], last write [2024-10-24 15:01:54.000]
2024-10-24 15:08:29.451 [REPO] Performing search: Query:[none] Include:ProductCode='27a75bf3-be48-5c35-934f-8491cf108abe'[Exact] Include:NormalizedNameAndPublisher='drawio'+'jgraph'[Exact]

Environment

Windows Package Manager v1.8.1911
Copyright (c) Microsoft Corporation. All rights reserved.

Windows: Windows.Desktop v10.0.22631.4317
System Architecture: X64
Package: Microsoft.DesktopAppInstaller v1.23.1911.0

Winget Directories

Logs %LOCALAPPDATA%\Packages\Microsoft.DesktopAppInstaller_8wekyb3d8bbwe\LocalState\DiagOutputDir
User Settings %LOCALAPPDATA%\Packages\Microsoft.DesktopAppInstaller_8wekyb3d8bbwe\LocalState\settings.json
Portable Links Directory (User) %LOCALAPPDATA%\Microsoft\WinGet\Links
Portable Links Directory (Machine) C:\Program Files\WinGet\Links
Portable Package Root (User) %LOCALAPPDATA%\Microsoft\WinGet\Packages
Portable Package Root C:\Program Files\WinGet\Packages
Portable Package Root (x86) C:\Program Files (x86)\WinGet\Packages
Installer Downloads %USERPROFILE%\Downloads

Links

Privacy Statement https://aka.ms/winget-privacy
License Agreement https://aka.ms/winget-license
Third Party Notices https://aka.ms/winget-3rdPartyNotice
Homepage https://aka.ms/winget
Windows Store Terms https://www.microsoft.com/en-us/storedocs/terms-of-sale

Admin Setting State

LocalManifestFiles Disabled
BypassCertificatePinningForMicrosoftStore Disabled
InstallerHashOverride Disabled
LocalArchiveMalwareScanOverride Disabled
ProxyCommandLineOptions Disabled
DefaultProxy Disabled

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    Area-PerformanceIssue related to CPU or memory performanceCommand-ListIssue related to WinGet ListIssue-BugIt either shouldn't be doing this or needs an investigation.

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions