bitsquid_dt/dtmt
bitsquid_dt/dtmt
2
Fork 0
Code Issues 35 Pull requests 1 Projects 1 Releases 3 Packages 1 Wiki Activity
Var Dump: 
dumpVar: only available in dev mode
Mailing List

Listing files from bundle database seems awfully slow #196

New issue
Open
opened 2024-09-03 18:19:08 +02:00 by lucas · 1 comment
lucas commented 2024-09-03 18:19:08 +02:00
Owner
Copy link

dtmt bundle db list-files | pv -trab > /dev/null shows less than 100 KiB/s.
Given that the whole database needs to be parsed into memory before writing can even begin, this seems extremely slow for simply writing out from memory.

Probably some serious mishap with allocations. Will need to profile.

`dtmt bundle db list-files | pv -trab > /dev/null` shows less than 100 KiB/s. Given that the whole database needs to be parsed into memory before writing can even begin, this seems extremely slow for simply writing out from memory. Probably some serious mishap with allocations. Will need to profile.
lucas added the
kind
bug
crate/dtmt
status/good first issue
 labels 2024-09-03 18:19:08 +02:00
lucas commented 2024-09-03 18:41:42 +02:00
Author
Owner
Copy link

A release build goes up to 330 KiB/s at least, but I still feel like MiB/s should be possible.

A release build goes up to 330 KiB/s at least, but I still feel like MiB/s should be possible.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
feat/textures
experiment/word-generation
feat/updates
wip/loose-files
feat/code-sign
feat/widget-extra
dtmm-v1.0.0-rc3
dtmm-v1.0.0-rc2
dtmm-v1.0.0-rc1
dtmm-v1.0.0-rc0
dtmt-v0.3.0
dtmm-v0.1.0
v0.2.0
v0.1.1
Labels
Clear labels   
ci

   
crate/dtmm

   
crate/dtmt

   
crate/sdk

   
crate/serde_sjson
  
kind
bug
Something is not working

  
kind
documentation
Documentation needs to be adjusted

  
kind
enhancement
Improvement of existing functionality

  
kind
feature
New behaviour or functionality

  
kind
question
User is asking a question

  
kind
upstream
Root cause can be found in a dependency

  
part/bundle

   
part/filetype
  
stage
actionable

  
stage
design

  
stage
proposal

  
status/duplicate

This issue or pull request already exists

  
status/good first issue

Simple and/or isolated changes that can serve as an introduction to the code base

  
status/help wanted

   
status/invalid

Something is wrong

  
status
need-replicate
Additional information required to replicate the issue for debuggin

  
status/wontfix

This won't be fixed

No labels
ci
crate/dtmm
crate/dtmt
crate/sdk
crate/serde_sjson
kind
bug
kind
documentation
kind
enhancement
kind
feature
kind
question
kind
upstream
part/bundle
part/filetype
stage
actionable
stage
design
stage
proposal
status/duplicate
status/good first issue
status/help wanted
status/invalid
status
need-replicate
status/wontfix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: bitsquid_dt/dtmt#196
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?