profile
viewpoint
If you are wondering where the data of this site comes from, please visit https://api.github.com/users/guskovd/events. GitMemory does not store any data, but only uses NGINX to cache data for a period of time. The idea behind GitMemory is simply to give users a better reading experience.

guskovd/emacs-solargraph 27

Ruby auto-completion for Emacs

guskovd/doha 2

Docker virtual environment for habitat.sh

guskovd/hab-shell 2

Habitat Nix shell implementation

guskovd/audacity 0

Audio Editor

guskovd/chef-dk 0

A streamlined development and deployment workflow for Chef platform.

guskovd/cloudbaseinit-bin 0

cloudbaseinit-bin

guskovd/docker-habitat 0

Habitat.sh docker wrapper

issue commenttriton-inference-server/server

How to find out the number of unprocessed requests for an inference?

@guskovd one workaround could be to utilize the number of executions performed (exposed by model metrics) and keep track of the number of requests sent for inference (on your client side) to be able to get the number of unprocessed requests.

Thank you. Yes, I decided to stay on this option for now.

But for many reasons this is not a very correct approach ... I would very much like the tritonserver to be able to count the number of received, but unprocessed requests for inference

guskovd

comment created time in a month

issue openedhyperium/tonic

How to handle client interrupts?

Let's say there is a simple service:

rpc Some(SomeRequest) returns (SomeResponse)

what is converted to

    async fn some(
        &self,
        request: Request<SomeRequest>,
    ) -> Result<Response<SomeResponse>, Status> {
    ...
    }

Service works, everything is fine

But what if I need to handle client interrupts? I tried to simulate this situation and I have a feeling that in this case the some method just exits immediately

created time in a month

issue commenttriton-inference-server/server

How to find out the number of unprocessed requests for an inference?

It is not possible to get the estimate on how long your request will take while the inference is being made. However, you can use perf_analyzer to find the average queuing time of your request offline. Perf analyzer includes the breakdown of your latency including the queuing time for the request. I understand it. But is there any way to find out how many inferences are in the queue at the current time?

guskovd

comment created time in a month

issue openedtriton-inference-server/server

How to find out the number of unprocessed requests for an inference?

I am interested in the ability to receive information about the length of the queue for the inference, so that the client can imagine how long it will take for him to wait until the request is processed.

I was able to find the ModelStatisticsRequest method. But it seems that it only gives information about completed inferences.

created time in a month

issue commentemacs-ng/emacs-ng

`exwm` does not work correctly

I can tell that exwm worked fine in commit: https://github.com/emacs-ng/emacs-ng/commit/cdb88483ac932cb8109fc24287bfc80e4c661b67 There are a lot of changes between this commit and the last one. emacs-ng takes a long enough time to figure out where it broke, and it takes too much time and effort.

guskovd

comment created time in a month

issue commentemacs-ng/emacs-ng

`exwm` does not work correctly

I'm pretty sure he's talking about your emacs-ng build configuration, not your init file.

I am building a package with flake.nix from the last commit

guskovd

comment created time in a month

issue commentemacs-ng/emacs-ng

`exwm` does not work correctly

Even the simplest config does not work for me:

(require 'exwm)
(require 'exwm-config)
(exwm-config-default)
guskovd

comment created time in a month

issue commenttriton-inference-server/server

The question of interrupting streams

Even the simplest config does not work for me:

(require 'exwm)
(require 'exwm-config)
(exwm-config-default)
guskovd

comment created time in a month

issue commentemacs-ng/emacs-ng

`exwm` does not work correctly

I've been using the old version for a long time:

Everything worked well

After that, I tried to update emacs-ng several times but ran into this error. I think it broke much earlier than https://github.com/emacs-ng/emacs-ng/pull/327

guskovd

comment created time in a month

issue openedemacs-ng/emacs-ng

`exwm` does not work correctly

I was unable to run exwm on the latest version of emacs-ng. When I start the X server, I see a white screen

created time in a month

issue commenttriton-inference-server/server

The question of interrupting streams

Once requests are queued up in Triton, we cannot know which requested are from dropped clients. I guess one feature would be to clear the request queue. @guskovd Would this be an acceptable solution?

It would be great for us to just learn how to get information about the server load, that is, to find out the number of pending requests for inference. I found ModelStatisticsRequest, but I still don't understand how to get what I need from it.

guskovd

comment created time in 2 months

issue openedtriton-inference-server/server

Stream interruption question

Hello.

We are using tritonserver to get inference from the GPU using a stream via GRPC.

It so happens that our application may restart. At such moments, it seems that the tritonserver cannot accept new requests for inference and is somehow trying to process incomplete requests.

Is this normal behavior from your point of view? And is it possible to somehow control this behavior using the config / command line arguments? (Ideally, we would like the tritonserver to terminate all streams for dropped clients)

--

Triton server/client (protobuf files version) version: 20.06 GPU: Tesla T4

created time in 2 months

issue closedemacs-ng/emacs-ng

nix build error: `cp: cannot create directory '/build/crates': No such file or directory`

To Reproduce

nix build github:emacs-ng/emacs-ng

output:

error: builder for '/nix/store/9962x85cl1fj5aqr4mbw8d76k7p4jrz5-remacsLibDeps-vendor.tar.gz.drv' failed with exit code 1;
       last 6 log lines:
       > unpacking sources
       > unpacking source archive /nix/store/vhvxc1j073yn2p6gxxwfbps03q3rm9qs-source/rust_src/remacs-lib
       > source root is remacs-lib
       > patching sources
       > building
       > cp: cannot create directory '/build/crates': No such file or directory
       For full logs, run 'nix log /nix/store/9962x85cl1fj5aqr4mbw8d76k7p4jrz5-remacsLibDeps-vendor.tar.gz.drv'.
error: 1 dependencies of derivation '/nix/store/dqrhlnigppqn2gdhlflb9nqyl2w54gf6-emacsNg-rust.drv' failed to build
error: 1 dependencies of derivation '/nix/store/y12vvyccrn63sh65cvndxh9ln59011i8-emacsNg-bc889e9.drv' failed to build

closed time in 2 months

guskovd

push eventguskovd/emacs-ng

Danil Guskov

commit sha b264cd3bb13e41744253046d558263aafddf3293

rollback

view details

push time in 2 months

issue openedemacs-ng/emacs-ng

nix build error: `cp: cannot create directory '/build/crates': No such file or directory`

To Reproduce

nix build github:emacs-ng/emacs-ng

outputs:

error: builder for '/nix/store/9962x85cl1fj5aqr4mbw8d76k7p4jrz5-remacsLibDeps-vendor.tar.gz.drv' failed with exit code 1;
       last 6 log lines:
       > unpacking sources
       > unpacking source archive /nix/store/vhvxc1j073yn2p6gxxwfbps03q3rm9qs-source/rust_src/remacs-lib
       > source root is remacs-lib
       > patching sources
       > building
       > cp: cannot create directory '/build/crates': No such file or directory
       For full logs, run 'nix log /nix/store/9962x85cl1fj5aqr4mbw8d76k7p4jrz5-remacsLibDeps-vendor.tar.gz.drv'.
error: 1 dependencies of derivation '/nix/store/dqrhlnigppqn2gdhlflb9nqyl2w54gf6-emacsNg-rust.drv' failed to build
error: 1 dependencies of derivation '/nix/store/y12vvyccrn63sh65cvndxh9ln59011i8-emacsNg-bc889e9.drv' failed to build

created time in 3 months

fork guskovd/emacs-ng

A new approach to Emacs - Including TypeScript, Threading, Async I/O, and WebRender.

https://emacs-ng.github.io/emacs-ng/

fork in 3 months

push eventguskovd/emacs-ng

Danil Guskov

commit sha c90f6b7669eba960c331cd314c28fa62f5c289df

update

view details

push time in 3 months

push eventguskovd/boost-snapshot

Danil Guskov

commit sha 0be5c315a50f9d38786d9953f31554066d12b21e

move boost_1_75_0.tar.gz to release

view details

push time in 3 months

created tagguskovd/boost-snapshot

tag1.75.0

created time in 3 months

release guskovd/boost-snapshot

1.75.0

released time in 3 months

push eventguskovd/boost-snapshot

Danil Guskov

commit sha c94cbfc9885ec60debfcb21d1b6910d2f6bd5cee

boost tar gz

view details

push time in 3 months

create barnchguskovd/boost-snapshot

branch : main

created branch time in 3 months

created repositoryguskovd/boost-snapshot

created time in 3 months