profile
viewpoint
Yong Tang yongtang San Francisco Bay Area, CA https://www.linkedin.com/in/yong-tang Open source contributor, CoreDNS, Docker, TensorFlow committer.

coredns/coredns 6587

CoreDNS is a DNS server that chains plugins

grpc/grpc-web 4753

gRPC for Web Clients

docker/swarmkit 2452

A toolkit for orchestrating distributed systems at any scale. It includes primitives for node discovery, raft-based consensus, task scheduling and more.

docker/docker-credential-helpers 542

Programs to keep Docker login credentials safe by storing in platform keystores

tensorflow/io 355

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

docker/go-connections 137

Utility package to work with network connections

docker/go-units 109

Parse and print size and time units in human-readable format

yongtang/clamav.js 21

A node.js library for ClamAV

yongtang/hadoop-xz 11

XZ (LZMA/LZMA2) Codec for Apache Hadoop

yongtang/clamav4j 5

Java library for ClamAV

issue commenttensorflow/io

Convert file system implementations to use C file system API in tensorflow

Before we can migrate to modular file system, additional work on tensorflow side is needed. The following is the progress of related PRs:

  • [x] PR https://github.com/tensorflow/tensorflow/pull/43209
  • [ ] PR https://github.com/tensorflow/tensorflow/pull/43424
yongtang

comment created time in a day

pull request commentcoredns/coredns

Revert "bump prometheus with zipkin (#4109)"

@miekg Actually I don't see the reference of sourcegraph.com in coredns after double-check. Tend to believe the issue is on Dependabot side?

yongtang

comment created time in a day

issue commentcoredns/coredns

Dependabot can't resolve your Go dependency files

We can revert the commit for now and file a bug to Dependabot. I have created a PR #4137 for the revert.

dependabot-preview[bot]

comment created time in a day

PR opened coredns/coredns

Reviewers
Revert "bump prometheus with zipkin (#4109)"

This reverts commit 8e1ab71720d09ad1d9b7f5cd55eac4705b4b047e.

See issue #4135 for details.

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+30 -145

0 comment

3 changed files

pr created time in a day

push eventcoredns/coredns

Yong Tang

commit sha b0d119c93fc9d3c7a32a49446ca68af91d9d45e2

Revert "bump prometheus with zipkin (#4109)" This reverts commit 8e1ab71720d09ad1d9b7f5cd55eac4705b4b047e. See issue #4135 for details. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in a day

create barnchcoredns/coredns

branch : zipkin-revert

created branch time in a day

PR opened tensorflow/tensorflow

Update to include filesystem:filesystem_interface in libtensorflow_framework.so

While trying to build a modular file system from outside of TF code tree (with pip install tf-nightly headers), the following error happens:

Symbol not found: _TF_SetStatus\n  Referenced

The reason for the error was caused by filesystem:filesystem_interface dependency in bazel is not part of the .so.

This PR add filesystem:filesystem_interface as part of the dependency.

Also filesystem:filesystem_interface replaces filesystem:modular_filesystem as dependency can be reduced to just need filesystem:filesystem_interface.

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+2 -1

0 comment

2 changed files

pr created time in a day

create barnchyongtang/tensorflow

branch : filesystem-deps

created branch time in a day

issue commentcoredns/coredns

plugin/route53 documentation of AWS SDK version

@millermatt See:

https://github.com/coredns/coredns/blob/master/go.mod#L10

millermatt

comment created time in 3 days

push eventtensorflow/io

Vignesh Kothapalli

commit sha fbf7839599c56de22497ca04b6808156fd0f0b04

kafka exp datasets streaming logic modifications (#1120)

view details

push time in 3 days

PR merged tensorflow/io

kafka experimental datasets streaming logic modifications

This PR addresses the issue: https://github.com/tensorflow/io/issues/947 by implementing the following:

  • The blocking logic when the stream_timeout is set has been modified in such a way that, polls for new messages during the data slump calls the Next OP periodically instead of just waiting within a single Next OP call. The current approach prevents frequent rebalance calls when the stream_timeout is very high and is unable to capture the incoming data once the waiting period starts.
  • the message_timeout parameter has been changed to message_poll_timeout to prevent confusion with stream_timeout.
  • Additional documentation has been added pertaining to the message_poll_timeout parameter.
+131 -81

0 comment

5 changed files

kvignesh1420

pr closed time in 3 days

PullRequestReviewEvent

push eventtensorflow/io

Daniel

commit sha c0db161362f6eb128a972a965255ca30ac6654e1

Enable parsing arrays of arbitrary dimensions from json files (#1125) * enabled parsing arrays from json files of arbitrary dimensions. * fixed lint issues. * increased scope of multi-dim tensor test, and allocated size 1 tensors for non-array json entries.

view details

push time in 3 days

PR merged tensorflow/io

Enable parsing arrays of arbitrary dimensions from json files

Continues on from this PR, where this comment suggested to add higher dimensions at a later stage. This PR was originally made following this comment.

I'm not sure how much the recursive design will sacrifice speed with the extra function calls, but I think the readability and simplicity is improved, and I think it's safe to assume that json files are unlikely to contain very large arrays, as this would be an inefficient storage method for such data.

+93 -131

2 comments

2 changed files

djl11

pr closed time in 3 days

PullRequestReviewEvent

push eventtensorflow/io

Vignesh Kothapalli

commit sha 0db6d6d43b56323dcfffa18ef92aab194f55628e

fix docstring indentations (#1126)

view details

push time in 3 days

PR merged tensorflow/io

fix docstring indentations for arrow, bigquery and ignite python api's

This PR addressed the issue: https://github.com/tensorflow/io/issues/861 and fixes the docstrings for the arrow, bigquery and ignite python api's.

Will raise a different PR to fix the API's in core as well.

+339 -348

0 comment

3 changed files

kvignesh1420

pr closed time in 3 days

PullRequestReviewEvent

issue closedcoredns/coredns

coredns restart on nodes and no error output

What happened: coredns always restart on my nodes. What you expected to happen: one is normal .

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?:

Environment:

  • the version of CoreDNS:
CoreDNS-1.6.7
linux/amd64, go1.13.6, da7f65b
  • Corefile:
apiVersion: v1
data:
  Corefile: |
    .:53 {
        errors
        health {
           lameduck 5s
        }
        ready
        kubernetes cluster.local in-addr.arpa ip6.arpa {
           pods insecure
           fallthrough in-addr.arpa ip6.arpa
           ttl 30
        }
        prometheus :9153
        forward . /etc/resolv.conf
        cache 30
        reload
        loadbalance
    }
kind: ConfigMap
metadata:
  creationTimestamp: "2020-09-16T15:27:26Z"
  managedFields:
  - apiVersion: v1
    fieldsType: FieldsV1
    fieldsV1:
      f:data: {}
    manager: kubeadm
    operation: Update
    time: "2020-09-16T15:27:26Z"
  - apiVersion: v1
    fieldsType: FieldsV1
    fieldsV1:
      f:data:
        f:Corefile: {}
    manager: kubectl
    operation: Update
    time: "2020-09-17T01:27:55Z"
  name: coredns
  namespace: kube-system
  resourceVersion: "98760"
  selfLink: /api/v1/namespaces/kube-system/configmaps/coredns
  uid: d6e40a7a-d8e8-4108-b0ae-cd19a994ec9e
                                            
  • logs, if applicable:
root@ubuntu:~# kubectl get pod -A |grep cor
kube-system   coredns-66bff467f8-pqpww                   1/1     Running            0          9h    100.75.86.129   server501   <none>           <none>
kube-system   coredns-66bff467f8-xbnqg                   0/1     CrashLoopBackOff   126        9h    100.88.67.198   server502   <none>           <none>
$ kubectl logs -n kube-system  coredns-66bff467f8-xbnqg 
.:53
[INFO] plugin/reload: Running configuration MD5 = 25c756253dfbdb23a23bab618a74ca05
CoreDNS-1.6.7
linux/amd64, go1.13.6, da7f65b

  • OS (e.g: cat /etc/os-release):
NAME="Ubuntu"
VERSION="16.04.6 LTS (Xenial Xerus)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 16.04.6 LTS"
VERSION_ID="16.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
VERSION_CODENAME=xenial
UBUNTU_CODENAME=xenial
  • Others:
$ cat /proc/cpuinfo  | grep processor  |wc -l
48
$ free -h
              total        used        free      shared  buff/cache   available
Mem:           125G         28G         51G        332M         45G         95G
Swap:            0B          0B          0B

closed time in 4 days

oldthreefeng

issue commentcoredns/coredns

coredns restart on nodes and no error output

Close as the issue is resolved.

oldthreefeng

comment created time in 4 days

push eventcoredns/coredns

Miek Gieben

commit sha 16d489851e47dc3902d17d0eff9b8ba9f3bc70cc

plugin/hosts: make hosts plugin cursive (#4131) nit-picking PR, when using the name of the plugin make it cursive. Signed-off-by: Miek Gieben <miek@miek.nl>

view details

push time in 4 days

delete branch coredns/coredns

delete branch : hosts-doc

delete time in 4 days

PR merged coredns/coredns

Reviewers
plugin/hosts: make hosts plugin cursive

nit-picking PR, when using the name of the plugin make it cursive.

+1 -1

1 comment

1 changed file

miekg

pr closed time in 4 days

PullRequestReviewEvent

push eventyongtang/io

Yong Tang

commit sha 501ced536d06584874b13d70e80f65f25790182b

Consolidate bazel version specification to always take from .bazelversion (#1116) This PR consolidate bazel version specification to always take from .bazelversion, in order to avoid out-of-sync in case of updates. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 117970ccd822ac27c395bee8f9899f179533f9a7

Add Prewitt and Sobel filter (#1115) Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Vignesh Kothapalli

commit sha b6816f9973e36343aaa537d05e8ef046836d122c

increase sleep time for schema registry setup (#1117)

view details

Vignesh Kothapalli

commit sha ccef84606fd3e556a4bda9fc4c38ffacc5c651ce

github action to push docker images to registry (#1114) * github action to push docker images to registry * modified docker username

view details

Vignesh Kothapalli

commit sha 1e4916819ac3e5a5590968e84fe46803e20d1ce3

Bug fix in github actions while pushing docker images to registry (#1119) * test docker push to registry * removed nightly stages * restored ci actions

view details

Yong Tang

commit sha 74ae80077ea9530ddcd30fe611ecd35f9cf5347b

Update namespace to allow the source code build on both tf-nightly and tensorflow 2.3.0 (#1123) There were some recent changes in TF code base. As such some adjustment in tensorflow-io is needed in order to allow building against tf-nightly (tf master) and tensorflow 2.3.0 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

emkornfield

commit sha 57c78ea28f1ef96ac5ce2de9d20f2899c563e09d

only update column_indices once. (#1122) * only update column_indices once. * Update bigquery_lib.h * Update bigquery_lib.h correct condition.

view details

Vignesh Kothapalli

commit sha 83de6bb232156df55b6b70b87b2bed1cb20dc61e

added elasticsearch test setup to kokoro workflow (#1124)

view details

push time in 5 days

push eventyongtang/io

Yong Tang

commit sha 74ae80077ea9530ddcd30fe611ecd35f9cf5347b

Update namespace to allow the source code build on both tf-nightly and tensorflow 2.3.0 (#1123) There were some recent changes in TF code base. As such some adjustment in tensorflow-io is needed in order to allow building against tf-nightly (tf master) and tensorflow 2.3.0 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

emkornfield

commit sha 57c78ea28f1ef96ac5ce2de9d20f2899c563e09d

only update column_indices once. (#1122) * only update column_indices once. * Update bigquery_lib.h * Update bigquery_lib.h correct condition.

view details

Vignesh Kothapalli

commit sha 83de6bb232156df55b6b70b87b2bed1cb20dc61e

added elasticsearch test setup to kokoro workflow (#1124)

view details

Yong Tang

commit sha 2e7494da9f088ff67d99402bd5a8205ea195af23

Work in Progress Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha a8ea55ddc7ec2501975a43fb089c0b94a29d1cc7

version Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 378c4413d6058ad6f399d0dc617c94036720b19b

Try Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 5 days

push eventyongtang/io

Yong Tang

commit sha 807a1eebb709d571ac0724ab5b6eb669f0f508d2

Work in Progress Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 06473fb8ad0303d0fcbc86ab4d31335023b4f3f3

version Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 74e1582d5e0e5d76ca96ec9bc853da86e3d2ea06

Try Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 5 days

push eventtensorflow/io

Vignesh Kothapalli

commit sha 83de6bb232156df55b6b70b87b2bed1cb20dc61e

added elasticsearch test setup to kokoro workflow (#1124)

view details

push time in 5 days

PR merged tensorflow/io

added elasticsearch test setup to kokoro workflow

This PR adds the elasticsearch test setup to the kokoro cpu workflow.

+1 -0

0 comment

1 changed file

kvignesh1420

pr closed time in 5 days

PullRequestReviewEvent

push eventcoredns/coredns

Miek Gieben

commit sha acf9a0fa19928e605ac8ac3314890c9fef73e16b

cache: default to DNSSEC (#4085) * cache: default to DNSSEC This change does away with the DNS/DNSSEC distinction the cache currently makes. Cache will always make coredns perform a DNSSEC query and store that result. If a client just needs plain DNS, the DNSSEC records are stripped from the response. It should also be more memory efficient, because we store a reply once and not one DNS and another for DNSSEC. Fixes: #3836 Signed-off-by: Miek Gieben <miek@miek.nl> * Change OPT RR when one is present in the msg. Signed-off-by: Miek Gieben <miek@miek.nl> * Fix comment for isDNSSEC Signed-off-by: Miek Gieben <miek@miek.nl> * Update plugin/cache/handler.go Co-authored-by: Chris O'Haver <cohaver@infoblox.com> * Update plugin/cache/item.go Co-authored-by: Chris O'Haver <cohaver@infoblox.com> * Code review; fix comment for isDNSSEC Signed-off-by: Miek Gieben <miek@miek.nl> * Update doc and set AD to false Set Authenticated Data to false when DNSSEC was not wanted. Also update the readme with the new behavior. Signed-off-by: Miek Gieben <miek@miek.nl> * Update plugin/cache/handler.go Co-authored-by: Chris O'Haver <cohaver@infoblox.com> Co-authored-by: Chris O'Haver <cohaver@infoblox.com>

view details

push time in 5 days

delete branch coredns/coredns

delete branch : cache-do-do

delete time in 5 days

PR merged coredns/coredns

Reviewers
cache: default to DNSSEC

This change does away with the DNS/DNSSEC distinction the cache currently makes. Cache will always make coredns perform a DNSSEC query and store that result. If a client just needs plain DNS, the DNSSEC records are stripped from the response.

It should also be more memory efficient, because we store a reply once and not one DNS and another for DNSSEC.

Fixes: #3836

+205 -45

2 comments

7 changed files

miekg

pr closed time in 5 days

issue closedcoredns/coredns

Cache plugin does not work when DO bit is set

<!-- Please use this template while reporting a bug and provide as much info as possible. Not doing so may result in your bug not being addressed in a timely manner. Thanks!

If the matter is security related, please disclose it privately via security@coredns.io -->

What happened: DNS queries with DO bit set will miss cache 100% of the time

What you expected to happen: CoreDNS to serve subsequent queries from cache

How to reproduce it (as minimally and precisely as possible): Running dig @<core-dns-ip> +dnssec google.com results in a cache miss while removing the +dnssec will result in a cache hit. After debugging, https://github.com/coredns/coredns/blob/master/plugin/cache/cache.go#L78 is always false while https://github.com/coredns/coredns/blob/master/plugin/cache/handler.go#L100 reflects the correct value set by the client.

  • the version of CoreDNS: master (https://github.com/coredns/coredns/commit/8013925b532d8a9e0d94a583c686a483cb665b80) Debug logging:
[INFO] plugin/cache: handler.go: qname=google.com., qtype=1, do=true
[INFO] plugin/cache: looking up key in cache: 15668015455082718403
[INFO] plugin/cache: cache miss
[INFO] plugin/cache: cache.go: qname=google.com., qtype=1, do=false
[INFO] plugin/cache: [IN google.com.] key: 3507767526084950336 - ttl: 3m20s
[INFO] 127.0.0.1:55203 - 18136 "A IN google.com. udp 39 true 4096" NOERROR qr,rd,ra 54 0.004500154s

closed time in 5 days

elliotfehr

push eventcoredns/coredns

Miek Gieben

commit sha 22b68466262219284a47063e7f7bf9a833d21b61

notes: update 1.7.1 (#4128) Updates the notes with latest PRs. I want the cache PR to be included in this release as well, if possible. Should release somewhere this week. Signed-off-by: Miek Gieben <miek@miek.nl>

view details

push time in 5 days

delete branch coredns/coredns

delete branch : release-note-update

delete time in 5 days

PR merged coredns/coredns

Reviewers
notes: update 1.7.1

Updates the notes with latest PRs. I want the cache PR to be included in this release as well, if possible.

Should release somewhere this week.

Signed-off-by: Miek Gieben miek@miek.nl

+10 -1

1 comment

1 changed file

miekg

pr closed time in 5 days

PullRequestReviewEvent

delete branch yongtang/io

delete branch : nightly-build

delete time in 5 days

push eventtensorflow/io

Yong Tang

commit sha 74ae80077ea9530ddcd30fe611ecd35f9cf5347b

Update namespace to allow the source code build on both tf-nightly and tensorflow 2.3.0 (#1123) There were some recent changes in TF code base. As such some adjustment in tensorflow-io is needed in order to allow building against tf-nightly (tf master) and tensorflow 2.3.0 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 5 days

PR merged tensorflow/io

Update namespace to allow the source code build on both tf-nightly and tensorflow 2.3.0

There were some recent changes in TF code base. As such some adjustment in tensorflow-io is needed in order to allow building against tf-nightly (tf master) and tensorflow 2.3.0

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+9 -2

0 comment

5 changed files

yongtang

pr closed time in 5 days

push eventyongtang/io

Yong Tang

commit sha 1f0179dc2496a5ef2062f44935f48aa990289ca0

version Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 6 days

PR opened tensorflow/io

Update namespace to allow the source code build on both tf-nightly and tensorflow 2.3.0

There were some recent changes in TF code base. As such some adjustment in tensorflow-io is needed in order to allow building against tf-nightly (tf master) and tensorflow 2.3.0

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+9 -2

0 comment

5 changed files

pr created time in 6 days

push eventyongtang/io

push time in 6 days

push eventyongtang/io

Yong Tang

commit sha be8c2d4eea7af65838712906b19c5e155f637baa

Update docs to reformat and conform to tensorflow_docs (#1112) This PR updates docs so that it conforms to tensorflow_docs lint. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 54c89b36ab58573887d1be240747fd14b47d9e77

Add support of multiple dimension tensor for tfio.experimental.serialization.decode_json (#1101) This PR tries to address the issue raised in 695 where it was not possible to use tfio.experimental.serialization.decode_json for entries of multi dimensional tensor, e.g. `'{"x":[[1.0]]}'`. Supporting unlimited dimensional tensor could be a challange so this PR takes a first step of support 2D tensor first. A follow up PR will be created for higher dimension tensors. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Vignesh Kothapalli

commit sha ee685ef10c969f0447ea4af251078b40c24d3be9

rebase fix (#1113)

view details

Yong Tang

commit sha 501ced536d06584874b13d70e80f65f25790182b

Consolidate bazel version specification to always take from .bazelversion (#1116) This PR consolidate bazel version specification to always take from .bazelversion, in order to avoid out-of-sync in case of updates. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 117970ccd822ac27c395bee8f9899f179533f9a7

Add Prewitt and Sobel filter (#1115) Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Vignesh Kothapalli

commit sha b6816f9973e36343aaa537d05e8ef046836d122c

increase sleep time for schema registry setup (#1117)

view details

Vignesh Kothapalli

commit sha ccef84606fd3e556a4bda9fc4c38ffacc5c651ce

github action to push docker images to registry (#1114) * github action to push docker images to registry * modified docker username

view details

Vignesh Kothapalli

commit sha 1e4916819ac3e5a5590968e84fe46803e20d1ce3

Bug fix in github actions while pushing docker images to registry (#1119) * test docker push to registry * removed nightly stages * restored ci actions

view details

Yong Tang

commit sha 015ffb6e34b9d8805839020aed1074034b65fdbb

Update namespace to allow the source code build on both tf-nightly and tensorflow 2.3.0 There were some recent changes in TF code base. As such some adjustment in tensorflow-io is needed in order to allow building against tf-nightly (tf master) and tensorflow 2.3.0 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 705da159200ee80405a5d7f83059a8f79d9bbf5f

Work in Progress Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 54e93b87d55c553d959f937ebc132a280a9e505a

Try Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 6 days

push eventyongtang/io

Yong Tang

commit sha 531e0a2970ff0b80c9b5904f08b1b9e019ce1d66

Try Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 6 days

create barnchyongtang/io

branch : nightly-build

created branch time in 6 days

push eventcoredns/coredns

Zou Nengren

commit sha 8e1ab71720d09ad1d9b7f5cd55eac4705b4b047e

bump prometheus with zipkin (#4109) Signed-off-by: zounengren <zounengren@cmss.chinamobile.com>

view details

push time in 6 days

PR merged coredns/coredns

Reviewers
bump prometheus with zipkin

Signed-off-by: zounengren zounengren@cmss.chinamobile.com

<!-- Thank you for contributing to CoreDNS! Please provide the following information to help us make the most of your pull request: -->

1. Why is this pull request needed and what does it do?

bump prometheus with zipkin

2. Which issues (if any) are related?

xref https://github.com/coredns/coredns/pull/4071

3. Which documentation changes (if any) need to be made?

none

4. Does this introduce a backward incompatible change or deprecation?

none

+141 -11

2 comments

3 changed files

zouyee

pr closed time in 6 days

PullRequestReviewEvent

push eventtensorflow/io

Vignesh Kothapalli

commit sha 1e4916819ac3e5a5590968e84fe46803e20d1ce3

Bug fix in github actions while pushing docker images to registry (#1119) * test docker push to registry * removed nightly stages * restored ci actions

view details

push time in 6 days

PR merged tensorflow/io

Bug fix in github actions while pushing docker images to registry

The current github action job docker-release is unable to find the script for building and testing the docker image. This PR fixes that issue.

+1 -0

1 comment

1 changed file

kvignesh1420

pr closed time in 6 days

PullRequestReviewEvent

issue commenttensorflow/io

[Question] Load multiple parquet files into a Dataset?

Happy to reopen as another issue if that's better.

@chaaland Would be great if you can open a new issue.

chaaland

comment created time in 6 days

push eventtensorflow/io

Vignesh Kothapalli

commit sha ccef84606fd3e556a4bda9fc4c38ffacc5c651ce

github action to push docker images to registry (#1114) * github action to push docker images to registry * modified docker username

view details

push time in 6 days

PR merged tensorflow/io

github action to push docker images to registry

This PR addresses the issue: https://github.com/tensorflow/io/issues/1087 by adding a GitHub action to test and push the docker images to the registry.

The docker image testing step has been migrated from the linux-test job to the new docker-release job.

+25 -14

3 comments

3 changed files

kvignesh1420

pr closed time in 6 days

PullRequestReviewEvent

delete branch yongtang/tensorflow

delete branch : filesystem

delete time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha c3b9c68ec806f80b2b0a7f5af27d7ef036ecbed7

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 9bdd135a69d914c108a40084bc0f87d65de3a439

Try to fix Android issue Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha ea89ae4070f31736b1e41044ea36ba52de6301ce

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha e7e16201b2f53fe79531b73ad577dd844f44647f

Try to fix Android issue Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

pull request commenttensorflow/io

Add Prewitt and Sobel filter

@kvignesh1420 The name is normally used with tf.name_scope See https://www.tensorflow.org/api_docs/python/tf/name_scope. It can also be passed to C++ kernel's name attributes (All C++ kernels by default generates a name attr once compiled). In tensorflow-io we haven't systematically pass name as needed. We should as we gradually improve the code base.

yongtang

comment created time in 8 days

delete branch yongtang/io

delete branch : prewitt

delete time in 8 days

push eventtensorflow/io

Yong Tang

commit sha 117970ccd822ac27c395bee8f9899f179533f9a7

Add Prewitt and Sobel filter (#1115) Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

PR merged tensorflow/io

Add Prewitt and Sobel filter

This PR adds Prewitt and Sobel filter under tfio.experimental.filter[prewitt|sobel]

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+121 -1

1 comment

3 changed files

yongtang

pr closed time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha 577924971727ddab72eabdde4beb0227369c07c9

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 57e44ef47c6efb0417c727f811eaa155eba49cb2

Try to fix Android issue Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha a1a55d32702d9c7cfd539fe6eded4978d55f04e4

Try to fix Android issue Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha edf9df59d6dcac92c6960725131437b5f60af621

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha d529a646d9d073fd0e0886d33fe46ee6adea5c71

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

delete branch yongtang/io

delete branch : bazelversion

delete time in 8 days

pull request commenttensorflow/io

Add Prewitt and Sobel filter

@terrytangyuan Different modes can be grouped into a separate tests with all ops suitable for padding. Maybe we can leave this PR alone? I will create a follow up PR for modes.

yongtang

comment created time in 8 days

PR opened tensorflow/tensorflow

Expose modular file system header in pip install package

This PR tries to expose modular file system header in pip install package so that downstream packages could use the header files with pip install

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+1 -0

0 comment

1 changed file

pr created time in 8 days

pull request commenttensorflow/io

github action to push docker images to registry

Thanks @kvignesh1420. I added ${{ secrets.DOCKER_PASSWORD }} to the configuration. For DOCKER_USERNAME I think you can just replace it with tfsigio directly.

kvignesh1420

comment created time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha a8d816558f95dc9af12210b7a54bea6393705ca1

Update headers [vendoring of leveldb 3/n] Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 432117d05d8a22f44c708dabb4553f3244ce97d0

Convert to leveldb [vendoring of leveldb n/n] Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 19400c428785fea09cef66b48f7fef581e0f7246

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

PR opened tensorflow/io

Consolidate bazel version specification to always take from .bazelversion

This PR consolidate bazel version specification to always take from .bazelversion, in order to avoid out-of-sync in case of updates.

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+12 -12

0 comment

1 changed file

pr created time in 8 days

PR opened tensorflow/io

Add Prewitt and Sobel filter

This PR adds Prewitt and Sobel filter under tfio.experimental.filter[prewitt|sobel]

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+121 -1

0 comment

3 changed files

pr created time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha 31953ce99408c04b3dbbe3dbf969450deca80d15

Delete leveldb files [vendoring of leveldb 2/n] Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 3c4df2159ef6829d268d5ac80d1e1d86a16e7143

Update to redirect to leveldb header files [vendoring of leveldb 3/n] Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha c03b7f16ca586b11482d4da4b321ab09ee051096

Update headers [vendoring of leveldb 3/n] Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 63b4da0a3507e43fd921c1674ee96325666b82dd

Convert to leveldb [vendoring of leveldb n/n] Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha fcb0976b381c8f3d44c50cc195b2b38a2fb45f18

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha de27e7875333dcdef9ed2b276abd4adef92c2676

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

push eventyongtang/tensorflow

Yong Tang

commit sha a8e26f1c63f283de4e67ddc145d801db4fd217e9

Adjust Bazel BUILD files to fix buildifier issue, and Windows fix Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 8 days

PR opened tensorflow/tensorflow

Move LevelDB code to third_party vendoring in Bazel

This PR is part of the effort to resolve the issue raised in #43015 where the files from levelDB have conflicting copyright/license info than TensorFlow.

This PR moves all levelDB files out of the repo, and, replaced with the vendoring of LevelDB directly.

Some additional updates has been make so that leveldb::[WritableFile|RandomAccessFile|Status] can be converted to TF's [WritableFile|RandomAccessFile|Status].

The leveldb::Slice has also been converted to StringPiece.

This PR fixes #43015.

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+280 -3565

0 comment

30 changed files

pr created time in 8 days

create barnchyongtang/io

branch : bazelversion

created branch time in 9 days

push eventyongtang/io

Yong Tang

commit sha d084e33f459ab267f59728f3c9500ab2620255e8

Add Prewitt and Sobel filter Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 9 days

create barnchyongtang/io

branch : prewitt

created branch time in 9 days

push eventyongtang/io

Yong Tang

commit sha 54c89b36ab58573887d1be240747fd14b47d9e77

Add support of multiple dimension tensor for tfio.experimental.serialization.decode_json (#1101) This PR tries to address the issue raised in 695 where it was not possible to use tfio.experimental.serialization.decode_json for entries of multi dimensional tensor, e.g. `'{"x":[[1.0]]}'`. Supporting unlimited dimensional tensor could be a challange so this PR takes a first step of support 2D tensor first. A follow up PR will be created for higher dimension tensors. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Vignesh Kothapalli

commit sha ee685ef10c969f0447ea4af251078b40c24d3be9

rebase fix (#1113)

view details

push time in 9 days

push eventyongtang/tensorflow

Yong Tang

commit sha c1ed2001c341a96cb5fb898277b55530c140010b

Bazel update [vendoring of leveldb 1/n] This PR is part of the effort to resolve the issue raised in 43015 where the files from levelDB have conflicting copyright/license info than TensorFlow. This PR moves all levelDB files out of the repo, and, replaced with the vendoring of LevelDB directly. Some additional updates has been make so that `leveldb::[WritableFile|RandomAccessFile|Status]` can be converted to TF's `[WritableFile|RandomAccessFile|Status]`. The `leveldb::Slice` has also been converted to `StringPiece`. This PR fixes 43015. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 30a40c1663e4725a1806fadadf8431c49fd35708

Delete leveldb files Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 52458b1c61b568768f067855fedef9ab391075b5

Update to redirect to leveldb header files Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 2f5cba62ea714b5d3d534fe8dfc38c0ab91c7cad

Update headers Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha f9158584bdeb8849d4968d777b54ae9bb815ffd5

Convert to leveldb Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 9 days

push eventyongtang/tensorflow

Yong Tang

commit sha 397bfa5d795b433b9de30c27004b6c2d2e84a943

Bazel update Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 9e89dc65773378e1634f50d771ce755034998ae2

Delete leveldb files Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha f932b997776beaa9b9adb09b1afc78f187bad558

Update to redirect to leveldb header files Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 3be52f756a5166af988e77b1dabd423e3d6e1470

Update headers Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 50d5e6fd3046e0698eed4b5dec10bec13486e9af

Convert to leveldb Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 9 days

push eventyongtang/tensorflow

Yong Tang

commit sha cfff17baa2a33c7f190e44bc37797949814c2194

Bazel update Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 8122d92406d5dedafe772fc749c3f194c1cc0c49

Delete leveldb files Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 6b3888b07027bbd29af29db6132fc31d84fca931

Update to redirect to leveldb header files Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 4db24ce0de5f046c194b73c67a12dcae5863686a

Adjust Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha d114bea3bb6026b42a6e90975cfee6cea86cf12b

Update headers Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 23877c40adf35e800505b009c2dc1a823f440770

Convert to leveldb Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 10 days

push eventtensorflow/io

Vignesh Kothapalli

commit sha ee685ef10c969f0447ea4af251078b40c24d3be9

rebase fix (#1113)

view details

push time in 10 days

PR merged tensorflow/io

Upgrade bazel version to fix kokoro ci issue

This PR upgrades the bazel version to 3.1.0 for the CI jobs so that the Kokoro jobs don't fail.

The kokoro env seems to have the bazel 3.1.0 version already setup while running the CI jobs and it is conflicting with the 3.0.0 version mentioned in .bazelversion file.

+14 -14

1 comment

3 changed files

kvignesh1420

pr closed time in 10 days

PullRequestReviewEvent

delete branch yongtang/io

delete branch : json_multiple_dimension_tensor

delete time in 10 days

push eventtensorflow/io

Yong Tang

commit sha 54c89b36ab58573887d1be240747fd14b47d9e77

Add support of multiple dimension tensor for tfio.experimental.serialization.decode_json (#1101) This PR tries to address the issue raised in 695 where it was not possible to use tfio.experimental.serialization.decode_json for entries of multi dimensional tensor, e.g. `'{"x":[[1.0]]}'`. Supporting unlimited dimensional tensor could be a challange so this PR takes a first step of support 2D tensor first. A follow up PR will be created for higher dimension tensors. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 10 days

PR merged tensorflow/io

Add support of multiple dimension tensor for tfio.experimental.serialization.decode_json

This PR tries to address the issue raised in https://github.com/tensorflow/io/pull/695#issuecomment-683270751 where it was not possible to use tfio.experimental.serialization.decode_json for entries of multi dimensional tensor, e.g. '{"x":[[1.0]]}'.

Supporting unlimited dimensional tensor could be a challange so this PR takes a first step of support 2D tensor first.

A follow up PR will be created for higher dimension tensors.

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+116 -34

2 comments

2 changed files

yongtang

pr closed time in 10 days

pull request commenttensorflow/io

Add support of multiple dimension tensor for tfio.experimental.serialization.decode_json

@terrytangyuan The PR has been rebased to fix the lint errors.

yongtang

comment created time in 10 days

push eventyongtang/io

Yong Tang

commit sha be8c2d4eea7af65838712906b19c5e155f637baa

Update docs to reformat and conform to tensorflow_docs (#1112) This PR updates docs so that it conforms to tensorflow_docs lint. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 10 days

push eventyongtang/io

Vignesh Kothapalli

commit sha 95b4ac7eca8734cefbca7e09f7f4fad8ac6bed08

Elasticsearch: headers support for retrieving data (#1110) * headers support for retrieving data * modify docstring * formatted connection error message * lint fix

view details

Yong Tang

commit sha be8c2d4eea7af65838712906b19c5e155f637baa

Update docs to reformat and conform to tensorflow_docs (#1112) This PR updates docs so that it conforms to tensorflow_docs lint. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha f8c4b549877ef6b10025b794ec0b8373cd61b544

Add support of multiple dimension tensor for tfio.experimental.serialization.decode_json This PR tries to address the issue raised in 695 where it was not possible to use tfio.experimental.serialization.decode_json for entries of multi dimensional tensor, e.g. `'{"x":[[1.0]]}'`. Supporting unlimited dimensional tensor could be a challange so this PR takes a first step of support 2D tensor first. A follow up PR will be created for higher dimension tensors. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 10 days

create barnchyongtang/io

branch : azfs

created branch time in 10 days

delete branch yongtang/io

delete branch : docs-format

delete time in 10 days

push eventtensorflow/io

Yong Tang

commit sha be8c2d4eea7af65838712906b19c5e155f637baa

Update docs to reformat and conform to tensorflow_docs (#1112) This PR updates docs so that it conforms to tensorflow_docs lint. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 10 days

PR merged tensorflow/io

Update docs to reformat and conform to tensorflow_docs

This PR updates docs so that it conforms to tensorflow_docs lint.

Signed-off-by: Yong Tang yong.tang.github@outlook.com

+18 -446

1 comment

9 changed files

yongtang

pr closed time in 10 days

issue commenttensorflow/io

Discussion: Official docker image for tensorflow-io

@kvignesh1420 tfsigio works: https://hub.docker.com/r/tfsigio/tfio/tags

kvignesh1420

comment created time in 10 days

more