profile
viewpoint

ButzYung/SystemAnimatorOnline 7

System Animator 11 (BETA), online version

ButzYung/human 0

Human: 3D Face Detection, Body Pose, Hand & Finger Tracking, Iris Tracking and Age & Gender Prediction

ButzYung/three.js 0

JavaScript 3D library.

fork ButzYung/kalidokit

Blendshape and kinematics calculator for Mediapipe/Tensorflow.js Face, Eyes, Pose, and Finger tracking models.

https://kalidoface.com

fork in 6 days

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha a09f5379692dfd7d63d77d131859197fd5751697

Update three.core.min.js

view details

push time in 23 days

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha 7cbf413181055d544f74dfd3f2b03e0b87801d05

Fix input focus for settings when mouse event mode is toggled

view details

ButzYung

commit sha 5ab530d2952aef3f418eb064e7bad939ac3d7279

Fix the bug about click-thru and "always on top" modes not working at the same time

view details

ButzYung

commit sha f815456b84d686de29a710b7f0edcd314ac9a1d0

Support customized default animation via "animation_path_default.txt" on Electron

view details

ButzYung

commit sha 3ee4f8ad3297bf03bbb9ebe7189bf86780a824cf

Fix remote.getGlobal issues for newer version of Electron

view details

ButzYung

commit sha 80952c809240deb051be9b65db34718fd820bae2

Add overlay_mode

view details

ButzYung

commit sha 192451c7610548f78e73dc57b6e53bf59dd64a28

Update electron_main.js Fix issues for remote.getGlobal for newer version of Electron

view details

ButzYung

commit sha cc591341fa5ec5f3a028d9535367eef2225e2cd2

Fix bb.scale issues

view details

ButzYung

commit sha 3276783cd3ed7bdd266c58efb7009f794e1a9fc6

Update SA_system_emulation.js

view details

ButzYung

commit sha 9a554e4f6452c006a8b3a11528b910080aa66072

Fix IK/addTrans issues for complicated bone system/add support for Ort camera

view details

ButzYung

commit sha 6ba8a46af1836ca60d83791d5b46fb36b671680a

Add support for Ort MMD camera

view details

ButzYung

commit sha 8e942658cf68f9e208ed5a8abf9eac8bf7feb663

Fix use_startup_screen/fix music file drop issue when MMD_SA_options.motion_shuffle is empty/fix speech bubble for Ort camera

view details

ButzYung

commit sha 159a6d6374fa238d44137b8a9ed10aeff91d2673

Fix EV_sync_update.fps_control issues

view details

push time in 23 days

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha 4d825aeb4f4ec588d2e5840ce8c878a44ee5cf86

Add camera depth estimation and misc fixes/change camera startup resolution

view details

ButzYung

commit sha daa30568753d660b1c4ca1262d764d70b48c4d2b

Update animate.js

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha 3c2be5b72ee616aa2605d3c655d2f62fa081e412

Fix Facemesh head rotation

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha eb1d7374d8b3aa232857956e36637d76425ca257

Update facemesh_worker.js

view details

ButzYung

commit sha 86d79e3b8f621fe20f9d09c9da114ca6ad64408a

Update pose_lib.js

view details

ButzYung

commit sha def10bba01a0e373e19ac61e55dee665382f5597

Improved support for Facemesh's "facemesh_bb_ratio" option

view details

ButzYung

commit sha b2b7b3bbc4ad973d479fe6bc02e06a237b6177ae

Update animate.js

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha e3df053051d5c8ae75ff0923054111fee1ee2909

Remove pose_worker from Facemesh worker

view details

ButzYung

commit sha 8f242a7a9e35dfbd776ad2546ca0c4e6511cacea

Change motion tracking AI config for mobile/change Facemesh tracking to face camera as well in some cases

view details

ButzYung

commit sha a5c8503c56a7228e79a6b15ee3c09c6983cb45bd

Change Facemesh tracking to face camera during AR session

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha 5454c05b30b639c70622c7904e8990f4b01021a2

Update .setEulerFromQuaternion

view details

ButzYung

commit sha 34fb859171f475bf83e861c562f3f911a123154d

Update motion list automatically when motion tracking is toggled

view details

push time in 2 months

pull request commentvladmandic/human

face angle as rotation matrix

@Shubhambindal2017 I use the three.js library for the conversions.

Quaternion.setFromRotationMatrix https://github.com/mrdoob/three.js/blob/dev/src/math/Quaternion.js

Euler.setFromQuaternion https://github.com/mrdoob/three.js/blob/dev/src/math/Euler.js

It seems the newer version of three.js is doing Euler.setFromQuaternion by turning the quaternion to a rotation matrix and then euler angles. For some reasons I am using the math library from an old version of three.js and they have a direct quaternion => euler function, but the results returned from these methods are basically the same.

ButzYung

comment created time in 2 months

pull request commentvladmandic/human

face angle as rotation matrix

@Shubhambindal2017 @vladmandic I have done a comparison between the angles returned by human and the angles calculated from the rotation matrix using another method (matrix => quaternions => eulers), and I think the 2x multiplification is unnecessary.

ButzYung

comment created time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha b91ec83f712102bccdb9afb5073c88305b5cf3f1

Use Mediapipe Facemesh for mobile by default

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha 25f19370a5d8200e170d95ace0f872262981822c

Fix for Mediapipe Facemesh

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha ab25709d2fb2f14be15f515c8ad6ea8994ca5777

Update animate.js

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha 1510869954166aefe117c92520fb7859f1ed76c2

Add support for uniTexture/fixes

view details

ButzYung

commit sha b307c322d33797c37576a1112700cbfbb5376611

Update core.js

view details

ButzYung

commit sha 034c85b7b4d8fdff1cc808905784564a399304f2

Support latest Electron (last tested on v16)

view details

ButzYung

commit sha d6d7478e4bec4556da7b64e38f095837a63bfb0f

Support full frame rate (60fps)

view details

ButzYung

commit sha 7fb7119f03eb19501461033dd715d20a9a6c3507

Support full frame rate (60fps)

view details

ButzYung

commit sha c4d93d0ebcc1787e25b258f0be886cf6e6e08874

Add "Just Snow" effect

view details

ButzYung

commit sha 456769f7daad61a38ce2a1a739692f2cb15124b0

Add support for custom hands

view details

ButzYung

commit sha ccdc952e6c6b1841ae3556e9cdb8df8e6fededd1

Electron remote module

view details

ButzYung

commit sha b3648555449397ebd5bfb5fd1f57730c52dd3094

Add support for "Just Snow" effect

view details

ButzYung

commit sha 3201e3f661db8f9cf3c5f6edcbcae0310a856036

Update assets.zip

view details

ButzYung

commit sha 0b192d2065a1d1f33cfa3f9ae6c12d9b0a55d529

Update source.txt

view details

ButzYung

commit sha f9884b7f6dbc5b9c26f8105a864947e7773437a1

pose_lib.js

view details

ButzYung

commit sha 979cf7ce0daf5ae1aff8a7721abf80b410940a7a

Update (see description) - add Mediapipe Facemesh support - obsolete posenet - remove blink detection - draw pose/hands even when Facemesh is disabled - other fixes

view details

ButzYung

commit sha eabffd99110a79f9838bd1dc4ce3932e8e00bf77

Update MMD_SA.js

view details

ButzYung

commit sha 4e3186d2f1c37e528ab58616a2ebeab314fb3768

uniTexture support/fixes

view details

ButzYung

commit sha b5ef0c9c878a74a084547d1b1c5d129ca07445df

Update SA_system_emulation.js

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha c12ade20e7ed3c9cc789c9a434bc4658294dccc4

3D support and fixes

view details

push time in 2 months

push eventButzYung/SystemAnimatorOnline

ButzYung

commit sha dca540cf308dc18221bcc231440471b2ad7263e2

@mediapipe modules

view details

push time in 2 months

issue openedvladmandic/human

Facemesh "beating" with the latest human

There is a strange problem regarding facemesh in the latest human. The detected facemesh keeps "beating" periodically, shriking in size at a certain frame and then growing back to normal in a few frames. I have recorded a video to better demonstrate the problem.

https://www.youtube.com/watch?v=1yzr42fxT90

The beat rate is directly related to the skipFrames property in the config (it's 15 in this video). If I change it to 1, the facemesh size will be jumping back and forth every other frame.

created time in 2 months

issue commentyeemachine/kalidokit

Hand movement towards body

@chris-aeviator Do you mean movements relative to the camera (e.g. walking towards/away from the camera)?

chris-aeviator

comment created time in 2 months

startedyeemachine/kalidokit

started time in 2 months

more