profile
viewpoint

mari-linhares/tensorflow-workshop 46

Code samples, slides and materials for TensorFlow Workshops

MarkDaoust/mvn 10

Multivariate Normal Distributions, in Python

MarkDaoust/tensorflow-workshop 1

Code samples for a TensorFlow Workshop [WIP]

MarkDaoust/addons 0

Useful extra functionality for TensorFlow 2.0 maintained by SIG-addons

MarkDaoust/agents 0

TF-Agents is a library for Reinforcement Learning in TensorFlow

MarkDaoust/altair 0

Declarative statistical visualization library for Python

MarkDaoust/beam 0

Apache Beam

MarkDaoust/dcgan-oreilly 0

Notebook for O'Reilly's "Deep Convolutional Generative Adversarial Networks"

push eventtensorflow/examples

abhinavsp0730

commit sha 046a5503445da2218bc60e830eb2ba4c6f2d8043

Update MonteCarloBlackScholes.ipynb

view details

Mark Daoust

commit sha d3f4de97363dad23258669846d513b65c612fe60

Merge pull request #160 from abhinavsp0730/fixes-6 Some minor typo fixes in MonteCarloBlackScholes.ipynb

view details

push time in 20 hours

PR merged tensorflow/examples

Reviewers
Some minor typo fixes in MonteCarloBlackScholes.ipynb cla: yes
+16 -16

1 comment

1 changed file

abhinavsp0730

pr closed time in 20 hours

pull request commenttensorflow/docs

change usage of tf.dataset.padded_batch

Hi, thanks for the fix but I'd kind of like to keep this one as is.

It works with nightly, and 2.2 will be out soon.

https://www.tensorflow.org/api_docs/python/tf/data/Dataset?version=nightly#padded_batch

It's easier for us move docs to tf-nightly when I make a doc-related fix to tensorflow, and then remove all the tf-nightly after a release. than to try to coordinate all the docs updates to get published on release.

Myeongchan-Kim

comment created time in 2 days

push eventshern2/docs

Mark Daoust

commit sha 7fd731e30105e77e4c0b22519b41ab8c8a22dd66

Use default padded_shapes.

view details

push time in 2 days

issue closedtensorflow/tensorflow

Broken link in Doc [ api_docs/python/tf/test ]

<em>Please make sure that this is a documentation issue. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:doc_template</em>

System information

  • TensorFlow version: TensorFlow Core 1.13
  • Doc Link: https://www.tensorflow.org/api_docs/python/tf/test

Describe the documentation issue The link pointing to the testing guide is broken. broken link - https://tensorflow.org/api_guides/python/test

A snapshot of the broken link, working as of 22nd Feb 2019

We welcome contributions by users. Will you be able to update submit a PR (use the doc style guide) to fix the doc Issue?

closed time in 2 days

ramithuh

issue commenttensorflow/tensorflow

Broken link in Doc [ api_docs/python/tf/test ]

Thanks, it looks like this is a duplicate of: #26645 I'll go fix that.

ramithuh

comment created time in 2 days

pull request commenttensorflow/docs

fixes conv2d layer output shape

Thanks.

benrobby

comment created time in 3 days

issue commenttensorflow/tensorflow

Reading a tensor from file in python which was saved using C++

Hi @dibya-pati,

Personally, if I had to get a tensor-value from a cpp program to a python program I'd try: serialize-tensor and parse-tensor first, since these have clear python implementations: serialize_tensor, and parse_tensor.

I'm no expert on the internals of tf-cpp or checkpoints, but I thing ops::Save, and ops:SaveV2 are part of the checkpoint system.

dibya-pati

comment created time in 3 days

push eventabhinavsp0730/examples

Rob Seward

commit sha c191e26209ed71197e85bcf28c5afd0d8d630237

Improve rgbDataFromBuffer execution time Remove debug printout Formatting

view details

Rob Seward

commit sha d7b3c48e8eabc52eead1ddef0ec31b91e0fcd790

Formatting

view details

Rob Seward

commit sha c0ff7fe3b128997fdf804667504b1c07e59d433a

Refactor ImageClassification ModelDataHandler to use Accelerate framework This speeds up the rgbDataFromBuffer method by about 1000%

view details

Rob Seward

commit sha f0182060b5cf1faddc3b7c150ed79a9bf129f96a

Merge branch 'master' into master

view details

Rob Seward

commit sha ddf21f05bd7c3656ca4ca38f5ba767563c2a9937

Update rgb conversion in GestureClassification example

view details

Rob Seward

commit sha f1a16042df3a7703fa637041b697eb579e1d11d1

Fix issue with non-quantized data

view details

Kilaru Yasaswi Sri Chandra Gandhi

commit sha c077c00a703e4d68c16c732ec6562059ffa7cfb6

Fixed bug An assertion is required here imo

view details

Kilaru Yasaswi Sri Chandra Gandhi

commit sha dfe33baeb9c5c44d759f9d60067a98453d3a3e3c

fix TODO typo

view details

Kilaru Yasaswi Sri Chandra Gandhi

commit sha 3a8dbfe74583035e0a0a26b1336c6cca394d681e

fix TODO typo

view details

MichaelSaffold

commit sha e1c20d268de78507e26f813032c3cda0248091ef

Fix broken link in README.md "TensorFlow Lite Android image classification example" links to a missing tensorflow.org page and returns a 404 error. The intended resource can be found as a markdown file in this repository and the link has been updated.

view details

Tian Lin

commit sha 52d3a310df161ddac060ea0533fde1fe4befa93a

Create `shared` folder as a single place for shared resources files. PiperOrigin-RevId: 287259224

view details

abhinavsp0730

commit sha cc935e4c9a92580370976bdeed8ebb79d5560ff0

Update tflite_c05_exercise_rock_paper_scissors.ipynb

view details

Copybara-Service

commit sha 7a0470c85c7420a33ffac800aaeb9b9e8df76f6d

Merge pull request #132 from abhinavsp0730:minor-comment-fixes PiperOrigin-RevId: 287588871

view details

Kilaru Yasaswi Sri Chandra Gandhi

commit sha c44debf3bc41f423c9c970c363f359a0c9c99751

Add cache

view details

Kilaru Yasaswi Sri Chandra Gandhi

commit sha 01f472e2de88b26eb56b079ced5884c9ccf2a43a

Add cache

view details

Copybara-Service

commit sha 31e6d656041ca2dc0df0bc3c9a010fc224a84769

Merge pull request #124 from kyscg:bugfix PiperOrigin-RevId: 287881888

view details

A. Unique TensorFlower

commit sha b88c894f3e949dbcb24493fa9dfff89b9b089315

Add PoseNet iOS example PiperOrigin-RevId: 287937538

view details

Copybara-Service

commit sha 9f7d80aff8214b358e4aea0b83f2648748990c4b

Merge pull request #69 from robseward:master PiperOrigin-RevId: 288309419

view details

Manish Aradwad

commit sha 0464c2c01febdae46203e93a32f2ce9c8e243596

Fixed the typo

view details

Manish Aradwad

commit sha 827f87f1254ed613374c410b8452ba5c627c614b

Change "realoaded" to "reloaded"

view details

push time in 3 days

push eventabhinavsp0730/examples

Mark Daoust

commit sha 787e2c62469366bbf0fa9ed5c2277ea0d2d7ad01

A few more typos.

view details

push time in 3 days

issue commenttensorflow/tensorflow

Keep version fixed when searching API docs

Hi @ianhellstrom

We've hidden all the old versions of the docs from search. We've also moved most of the old versions off the site, Into branches on the tensorflow_docs repository.

So I think this is fixed.

ianhellstrom

comment created time in 3 days

issue commenttensorflow/tensorflow

[TF 2.0 alpha] Keras Callbacks

Hi @snknitin,

Before tensorflow 2.0 keras metrics were sloppy about their naming.

IIRC with TF2.0+ if you say model.compile(..., metrics=['acc']) or model.compile(..., metrics=['accuracy']) the key used in the logs will match what you specified to the metric argument.

If you want more control over this you can always do model.compile(..., metrics=[keras.metrics.SparseCategoricalAccuracy(name='my_accuracy')]) and the name argument will be used as the log key.

Given that there are 5 upvotes I'll add a note to the tf2 migration guide. mentioning this before I close it.

snknitin

comment created time in 3 days

issue commenttensorflow/tensorflow

tools.graph_transforms.TransformGraph has no docs or example of usage

There's an extensive "readme" in the source directory:

https://github.com/tensorflow/tensorflow/tree/master/tensorflow/tools/graph_transforms

But we can't add this to tensorflow.org as it is not considered an implementation detail and not part of the public API.

Uiuran

comment created time in 3 days

issue commenttensorflow/tensorflow

Unable to find documentation for framework/ common run time files

We have this on our todo list: better documentation for tensorflow internals.

sthomdev

comment created time in 3 days

issue commenttensorflow/tensorflow

tf.keras.backend.set_floatx() causing ValueError (dtype conversion error) while computing tf.keras.metrics.*

Hi @Hemal-Mamtora ,

I think you're right.

It looks like this is being caused by the mismatch of metric.py recognizing floatx but metric_utils.py casting directly to float32 .

@pavithrasv, what's the right way to fix this?

Hemal-Mamtora

comment created time in 4 days

PR opened tensorflow/io

Prometheus - add sleep(10) for server startup.
+18 -5

0 comment

1 changed file

pr created time in 8 days

push eventMarkDaoust/io

Mark Daoust

commit sha 4a0834c28d88bddccbe64acf006cc89af9551055

Move sleep line

view details

push time in 8 days

push eventMarkDaoust/io

Mark Daoust

commit sha c1f0d00d57da6412c3038dbdc7d7561bd22bc03a

Remove tf_inspect patching. (#781) This is no longer necessary, and no longer works.

view details

Mark Daoust

commit sha d4687193c46193d516bf40d3f9c17f079afa99a6

Fix azure notebook (#782) * try: %ten sorflow_version * Update README.md * clear outputs * Set private outputs.

view details

Yong Tang

commit sha 8513fd0a6853391ccf4052bbb91dbdafa133f235

Add SQL version of Air Quality Data set, to be used by tutorial (#784) * Add SQL version of Air Quality Data set, to be used by tutorial Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Remove aapl as it is not open license Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Mark Daoust

commit sha 01c73c8eb5b8446fd9ca7567685144f736615141

Maybe fix npm install. (#785) * npm install azurite (no "-g") * set private_outputs

view details

Yong Tang

commit sha 609af2f9a2d2bc7f246b99e233809485824efb8f

Fix prometheus endpoint issue (#786) This PR fixes prometheus endpoint issue where `%d` should be '%s' Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 37ea2d64430e743b5623aadadece3d9a3b7cd2b8

Add a tutorial to load metrics from prometheus server (#774) * Add a tutorial to load metrics from prometheus server This PR adds tutorial to load metrics from prometheus server into tf.data.Dataset, so that it could be used for tf.keras and model training. Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * sudo apt-get + sudo apt + split dig commands. * Update docs/tutorials/prometheus.ipynb Co-Authored-By: Billy Lamberta <blamb@google.com> * Update docs/tutorials/prometheus.ipynb Co-Authored-By: Billy Lamberta <blamb@google.com> * Update docs/tutorials/prometheus.ipynb Co-Authored-By: Billy Lamberta <blamb@google.com> * Update docs/tutorials/prometheus.ipynb Co-Authored-By: Billy Lamberta <blamb@google.com> * Update docs/tutorials/prometheus.ipynb Co-Authored-By: Billy Lamberta <blamb@google.com> * Add sudo apt-get warning. * set private_outputs * Fix extra comma (`,`) Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Fix typo Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Move all imports into one block, as was suggested in review comment, also split shell and python block Signed-off-by: Yong Tang <yong.tang.github@outlook.com> * Move the server setup in early section to avoid `Unreachable` failure (server may take a second or two to start up) Signed-off-by: Yong Tang <yong.tang.github@outlook.com> Co-authored-by: Mark Daoust <markdaoust@google.com> Co-authored-by: Billy Lamberta <blamb@google.com>

view details

push time in 8 days

create barnchMarkDaoust/io

branch : prometheus

created branch time in 8 days

push eventMarkDaoust/io

Mark Daoust

commit sha 4f6e855de4008e67ce862d278fde40c9588a692e

sleep(10) to let the server startup

view details

push time in 8 days

push eventMarkDaoust/tensorflow

Yanhui Liang

commit sha 630230987727c03823363e5fb5f654aff954bfc4

Enable the disabled test in b/134670856. PiperOrigin-RevId: 292646148 Change-Id: Ieaa51721c20fd56b9980bdedc95755c8687daa96

view details

Skye Wanderman-Milne

commit sha 419ebe51e023e871590b19eb4df1c1fdbe9da51e

[XLA:Python] Allow multiple partitions to correspond to a single executable. XLA SPMD partitioning only produces a single executable, rather than one per partition. PiperOrigin-RevId: 292646667 Change-Id: I810c80578bbd9fe7e785aa4798a849ecaba8db30

view details

Peter Hawkins

commit sha 9fc5b891b8facc177a4fe654fa457882188bda0f

[XLA:Python] Add support for zero-copy NumPy -> XLA buffer transfers on CPU. When creating a PyLocalBuffer from a NumPy array, we don't need to copy the array if it is in the right layout and alignment already. This saves us a buffer copy and some thread hops. Note that a copy still occurs if the input NumPy array was not in C-contiguous layout. A copy will also take place if the NumPy array was not 64-byte aligned. Remove support for tuple trees in Buffer.from_pyval. JAX doesn't use tuple trees, and this simplifies the code and the API. PiperOrigin-RevId: 292650189 Change-Id: If6f7b34507c0aebc6dcbee136049b66e66d426c3

view details

Niranjan Hasabnis

commit sha c43ca1a8eecd273dd77721c930d3de517e3d0ff6

[Intel MKL] Patch for fix Shape compilation issue in MKL build

view details

A. Unique TensorFlower

commit sha 8e0e7a39bd22e810efcf04173e89d93cc0a798f2

Go: Update generated wrapper functions for TensorFlow ops. PiperOrigin-RevId: 292655096 Change-Id: I713e716aed56fa47a540ebb75b853116e2d912f3

view details

A. Unique TensorFlower

commit sha bb73a513b85c568610050821eff28b82a81d6e86

Automated rollback of commit 9cfa34fafa944f0d0392f4e5f237209f9e7cdfb6 PiperOrigin-RevId: 292658591 Change-Id: I6d5ff7925a63ee6874062d599c1d7997105d92e4

view details

Koan-Sin Tan

commit sha d768d147870b202559878c610c366a0ac536a748

[tflite] enable INT8 for Java binding some models created by full-integer post training quantization, e.g., the mobilenet v3 edgetpu one [1], have INT8 input and output tensors. [1] https://storage.cloud.google.com/mobilenet_edgetpu/checkpoints/mobilenet_edgetpu_224_1.0.tgz

view details

Gunhan Gulsoy

commit sha 191c028917f03e0c206ee2af9ea1aec80520cce7

Update subprocess_test. - Use resource_loader as it works cross platform. - also provide ".exe" sugffix for the programs on windows. - Enable it on windows. PiperOrigin-RevId: 292668803 Change-Id: I9439422b12bc81b0b764ffafdb71d67e0d5ba536

view details

A. Unique TensorFlower

commit sha 010bc7b9fe377ab3bdfe99f7263e10415848846d

Go: Update generated wrapper functions for TensorFlow ops. PiperOrigin-RevId: 292674103 Change-Id: I1c099794d31c21809c6f2dec8c476ca6eeb22092

view details

A. Unique TensorFlower

commit sha dd0518b5670899520b88394e2e2670647a2dceca

Go: Update generated wrapper functions for TensorFlow ops. PiperOrigin-RevId: 292682526 Change-Id: Ic2aaa662fb7c5863783556af2f3330db8c8c2bd6

view details

A. Unique TensorFlower

commit sha 6daded8f447db66a647e9c9bdb443a882aa43010

compat: Update forward compatibility horizon to 2020-02-01 PiperOrigin-RevId: 292683579 Change-Id: I81cd143df8321b6c75153b30ffc7692879c9a454

view details

Gunhan Gulsoy

commit sha 24fd250d738a08ce96973d9830c9c2792fa49a5a

Fix environment variable set on windows in vmodule_test PiperOrigin-RevId: 292689677 Change-Id: I441d9433fde748b7c17636341dc5c476c829103b

view details

A. Unique TensorFlower

commit sha 073460df145807ce4968718db793d8e2675b9d7e

Minor improved log statements for CheckpointSaverHook. PiperOrigin-RevId: 292692483 Change-Id: I07ab95f6e99e45f45e4cadba28926d4ebe44cb53

view details

Gaurav Singh

commit sha aafaf6745012198989c36151a6aba5a6521b588f

[core] nodedef nullptr dereference

view details

Gaurav Singh

commit sha 86374c2b0623ae3295ac3eb5d89f0fc95ba80bd0

[lite] pass array_names by const ref

view details

A. Unique TensorFlower

commit sha d15e205f9ee6192eea5682141694f3ea5cc0197d

Go: Update generated wrapper functions for TensorFlow ops. PiperOrigin-RevId: 292697654 Change-Id: I7ab889081535ae23c0cc9e57df84eab078732b39

view details

A. Unique TensorFlower

commit sha ea437ce27c9cb8a3de3145cdde6e4367bc0593f8

Fix failing ASan test due to out of boundary memory access PiperOrigin-RevId: 292701009 Change-Id: I2f964c9958f0b2863071707a463f03b3f4e16c11

view details

A. Unique TensorFlower

commit sha cb6a74e9e4d37e0c0784a63cec2240c3b4598ecb

Go: Update generated wrapper functions for TensorFlow ops. PiperOrigin-RevId: 292704437 Change-Id: I287f3309ba29397fe0217db1bbfbba602476d8d1

view details

Tamas Bela Feher

commit sha 34e82241b3e13570f5d4b70fe59ffdacda1d2b2d

Merge branch 'master' into trt_binding_indices

view details

Gunhan Gulsoy

commit sha c12da07ee88a68c77ca06ca058de029d2c78bb9e

Disable debug_ops_test on windows. It uses dirent.h, which does not exist on windows. PiperOrigin-RevId: 292710227 Change-Id: I3ad236b6bb482fb110b0ff6d78b4ed727f7bfdbf

view details

push time in 8 days

push eventyongtang/io

Mark Daoust

commit sha 7828d9a952b35d4119bc2283d54e85ec2b6823c2

set private_outputs

view details

push time in 9 days

Pull request review commenttensorflow/io

Add a tutorial to load metrics from prometheus server

+{+  "nbformat": 4,+  "nbformat_minor": 0,+  "metadata": {+    "colab": {+      "name": "prometheus.ipynb",+      "provenance": [],+      "collapsed_sections": [+        "Tce3stUlHN0L"+      ],+      "toc_visible": true+    },+    "kernelspec": {+      "name": "python3",+      "display_name": "Python 3"+    },+    "language_info": {+      "codemirror_mode": {+        "name": "ipython",+        "version": 3+      },+      "file_extension": ".py",+      "mimetype": "text/x-python",+      "name": "python",+      "nbconvert_exporter": "python",+      "pygments_lexer": "ipython3",+      "version": "3.6.3"+    }+  },+  "cells": [+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "Tce3stUlHN0L"+      },+      "source": [+        "##### Copyright 2020 The TensorFlow IO Authors."+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "cellView": "form",+        "colab_type": "code",+        "id": "tuOe1ymfHZPu",+        "colab": {}+      },+      "source": [+        "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n",+        "# you may not use this file except in compliance with the License.\n",+        "# You may obtain a copy of the License at\n",+        "#\n",+        "# https://www.apache.org/licenses/LICENSE-2.0\n",+        "#\n",+        "# Unless required by applicable law or agreed to in writing, software\n",+        "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",+        "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",+        "# See the License for the specific language governing permissions and\n",+        "# limitations under the License."+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "qFdPvlXBOdUN"+      },+      "source": [+        "# Load metrics from Prometheus server"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MfBg1C5NB3X0"+      },+      "source": [+        "<table class=\"tfo-notebook-buttons\" align=\"left\">\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://www.tensorflow.org/io/tutorials/prometheus\"><img src=\"https://www.tensorflow.org/images/tf_logo_32px.png\" />View on TensorFlow.org</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://colab.research.google.com/github/tensorflow/io/blob/master/docs/tutorials/prometheus.ipynb\"><img src=\"https://www.tensorflow.org/images/colab_logo_32px.png\" />Run in Google Colab</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://github.com/tensorflow/io/blob/master/docs/tutorials/prometheus.ipynb\"><img src=\"https://www.tensorflow.org/images/GitHub-Mark-32px.png\" />View source on GitHub</a>\n",+        "  </td>\n",+        "      <td>\n",+        "    <a href=\"https://storage.googleapis.com/tensorflow_docs/io/docs/tutorials/prometheus.ipynb\"><img src=\"https://www.tensorflow.org/images/download_logo_32px.png\" />Download notebook</a>\n",+        "  </td>\n",+        "</table>"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "xHxb-dlhMIzW"+      },+      "source": [+        "## Overview\n",+        "\n",+        "This tutorial will show how to load CoreDNS metrics into  `tf.data.Dataset` from a [Prometheus](https://prometheus.io) server, so that the loaded metrics could be represented as a `tf.data.Dataset` and passed to `tf.keras` for training or inference purposes.\n",+        "\n",+        "[CoreDNS](https://github.com/coredns/coredns) is a DNS server with a focus on service discovery, and is widely deployed as a part of the [Kubernetes](https://kubernetes.io) cluster. For that reason it is often closely monitoring by devops operations.\n",+        "\n",+        "This tutorial is an example that could be used by devops looking for automation in their operations through machine learning."+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MUXex9ctTuDB"+      },+      "source": [+        "## Setup and usage"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "upgCc3gXybsA",+        "colab_type": "text"+      },+      "source": [+        "### Install required tensorflow-io package, and restart runtime"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "uUDYyMZRfkX4",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "try:\n",+        "  %tensorflow_version 2.x\n",+        "except Exception:\n",+        "  pass\n",+        "!pip install tensorflow-io-nightly"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "yZmI7l_GykcW",+        "colab_type": "text"+      },+      "source": [+        "### Install and setup CoreDNS and Prometheus\n",+        "\n",+        "For demo purposes, a CoreDNS server locally with port `9053` open to receive DNS queries and port `9153` (defult) open to expose metrics for scraping. A simple Corefile configuration of CoreDNS is as follows and is available to be [downloaded](https://github.com/tensorflow/io/blob/master/docs/tutorials/prometheus/Corefile):\n",+        "```\n",+        ".:9053 {\n",+        "  prometheus\n",+        "  whoami\n",+        "}\n",+        "```\n",+        "\n",+        "More details about installation could be found on CoreDNS's [documentation](https://coredns.io).\n",+        "\n"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "YUj0878jPyz7",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!curl -s -OL https://github.com/coredns/coredns/releases/download/v1.6.7/coredns_1.6.7_linux_amd64.tgz\n",+        "!tar -xzf coredns_1.6.7_linux_amd64.tgz\n",+        "\n",+        "!curl -s -OL https://raw.githubusercontent.com/tensorflow/io/master/docs/tutorials/prometheus/Corefile\n",+        "\n",+        "!cat Corefile\n",+        "\n",+        "# Run `./coredns` as a background process.\n",+        "# IPython doesn't recognize `&` in inline bash cells.\n",+        "get_ipython().system_raw('./coredns &')"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "rXji6aQdPQ-a",+        "colab_type": "text"+      },+      "source": [+        "In order to show some activity, `dig` command could be used to generate a few DNS queries against the CoreDNS server that has been setup:"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "7XLuWyE3Pgg0",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!apt-get install -y -qq dnsutils\n",+        "\n",+        "!dig @127.0.0.1 -p 9053 demo1.example.org\n",+        "!dig @127.0.0.1 -p 9053 demo2.example.org"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "Afb01zkACsuW",+        "colab_type": "text"+      },+      "source": [+        "The next step is to setup Prometheus server and use Prometheus to scrape CoreDNS metrics that are exposed on port `9153` from above. The `prometheus.yml` file for configuration is also available for [download](https://github.com/tensorflow/io/blob/master/docs/tutorials/prometheus/prometheus.yml):\n"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "3HHfVdv9D3Jv",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!curl -s -OL https://github.com/prometheus/prometheus/releases/download/v2.15.2/prometheus-2.15.2.linux-amd64.tar.gz\n",+        "!tar -xzf prometheus-2.15.2.linux-amd64.tar.gz --strip-components=1\n",+        "\n",+        "!curl -s -OL https://raw.githubusercontent.com/tensorflow/io/master/docs/tutorials/prometheus/prometheus.yml\n",+        "\n",+        "# Run `./prometheus` as a background process.\n",+        "# IPython doesn't recognize `&` in inline bash cells.\n",+        "get_ipython().system_raw('./prometheus &')"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "f61fK3bXQH4N",+        "colab_type": "text"+      },+      "source": [+        "Now a CoreDNS server whose metrics are scraped by a Prometheus server and ready to be consumed by TensorFlow."+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "acEST3amdyDI",+        "colab_type": "text"+      },+      "source": [+        "### Create Dataset for CoreDNS metrics and use it in TensorFlow\n",+        "\n",+        "Create a Dataset for CoreDNS metrics that is available from PostgreSQL server, could be done with `tfio.experimental.IODataset.from_prometheus`. At the minimium two arguments are needed. `query` is passed to Prometheus server to select the metrics and `length` is the period we want to load into Dataset.\n",+        "\n",+        "You can start with \"coredns_dns_request_count_total\" and \"5\" (secs) to create the Dataset below. Since earlier in the tutorial two DNS queries were sent, it is expected that the metrics for \"coredns_dns_request_count_total\" will be \"2.0\" at the end of the time series:"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "h21RdP7meGzP",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "from datetime import datetime\n",+        "import tensorflow_io as tfio\n",+        "\n",+        "dataset = tfio.experimental.IODataset.from_prometheus(\n",

Since this notebook is spinning up servers and such, will this work when imported into tensorflow.org?

I think this part shouldn't be a problem.

yongtang

comment created time in 9 days

push eventtensorflow/io

Mark Daoust

commit sha 01c73c8eb5b8446fd9ca7567685144f736615141

Maybe fix npm install. (#785) * npm install azurite (no "-g") * set private_outputs

view details

push time in 9 days

PR merged tensorflow/io

Maybe fix npm install.

For #783

The install was failing silently.

+26 -5

5 comments

1 changed file

MarkDaoust

pr closed time in 9 days

pull request commenttensorflow/io

Maybe fix npm install.

!npm install azurite@2.7.0

Works locally, and in colab. Worth a shot. let's merge and see if that fixes the publisher.

MarkDaoust

comment created time in 9 days

push eventMarkDaoust/io

Mark Daoust

commit sha e61fd0c3804704387fa9faf1f0ba9bc2140c7af6

remove -g, --user

view details

push time in 9 days

push eventyongtang/io

Mark Daoust

commit sha b60283345f5a4eb5835ff33553183366edea093c

Add sudo apt-get warning.

view details

push time in 9 days

pull request commenttensorflow/docs

add installation instructions for TF2

Okay, let's try to figure this out on #36595, and propose a more specific fix since this pip page is meant to cover a lot more than just Debian Stable.

rushabh-v

comment created time in 9 days

IssuesEvent

issue commenttensorflow/tensorflow

'Tensor' object has no attribute 'numpy'

Hmmm...

Other than TensorFlow already being installed, the only way I can think of for pip install to get you an old version is if you're running a system or python version that we no longer support, pip might still find all the old bersions that are supported on that system.

could that be it? Any other ideas?

TheUnixDude

comment created time in 9 days

push eventyongtang/io

Mark Daoust

commit sha 89cf8f7e49cf560426eb56daa5d2ead729ec9021

sudo apt-get + sudo apt + split dig commands.

view details

push time in 9 days

issue closedtensorflow/tensorflow

'Tensor' object has no attribute 'numpy'

URL(s) with the issue:

https://www.tensorflow.org/tutorials/quickstart/beginner

Description of issue (what needs changing):

The instructions state, in the fourth block of sample code, to use a command which returns a fatal error.

predictions = model(x_train[:1]).numpy()

Clear description

When running the example, as written, on Debian Stable (python 3.7.3)

>>> predictions = model(x_train[:1]).numpy()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'Tensor' object has no attribute 'numpy'

closed time in 9 days

TheUnixDude

issue commenttensorflow/tensorflow

'Tensor' object has no attribute 'numpy'

I think so.

TheUnixDude

comment created time in 9 days

pull request commenttensorflow/docs

add installation instructions for TF2

I don't think this is correct.

You probably have tensorflow 1.14 installed, and "pip install tensorflow" says "tensorflow is already installed".

Try "pip install -U tensorflow".

rushabh-v

comment created time in 9 days

issue commenttensorflow/tensorflow

'Tensor' object has no attribute 'numpy'

Hi @rushabh-v

tensorflow version 2 - you get 1.14 as of today.

I don't think that's correct. You probably have tensorflow 1.14 installed, and "pip install tensorflow" says "tensorflow is already installed".

Try "pip install -U tensorflow".

TheUnixDude

comment created time in 9 days

CommitCommentEvent

issue commenttensorflow/tensorflow

Tensorflow installation document Korean translated page outdated

Hi @jungmin-lim,

Thanks for reporting this. The docs translations in the https://github.com/tensorflow/docs-l10n repository.

Can you copy this issue to that repository, and close this one? Thanks.

Also note that these translations are community owned. Since you seem to know how to correct this, I'm sure they'd love it if you can send a PR too.

Thanks.

jungmin-lim

comment created time in 9 days

issue commenttensorflow/io

Publish azure notebook

Thanks for the tips. It looks like the publisher got silently tripped up on the npm install step.

MarkDaoust

comment created time in 9 days

pull request commenttensorflow/io

Maybe fix npm install.

Done.

MarkDaoust

comment created time in 9 days

push eventMarkDaoust/io

Mark Daoust

commit sha fdcf0af5043dd3c6d72681e256ab9aeabc627c8c

clear outputs

view details

push time in 9 days

push eventMarkDaoust/io

push time in 9 days

push eventMarkDaoust/io

Mark Daoust

commit sha 56c0f0c105aedda89ad3fb8bdf969d153b6e83f4

clear outputs.

view details

push time in 9 days

push eventMarkDaoust/io

Mark Daoust

commit sha d131a5539fcd5beb5e533ec96fc05df743689c49

set private_outputs

view details

push time in 9 days

pull request commenttensorflow/io

Maybe fix npm install.

Wait, let me clear the output before merging.

MarkDaoust

comment created time in 9 days

PR opened tensorflow/io

Maybe fix npm install.

For #783

The install was failing silently.

+81 -6

0 comment

1 changed file

pr created time in 9 days

push eventMarkDaoust/io

Mark Daoust

commit sha 248be2d9baffbf400c4aeabaaa665c25a533431e

npm install --user -g azurite

view details

push time in 9 days

create barnchMarkDaoust/io

branch : azure

created branch time in 9 days

delete branch MarkDaoust/io

delete branch : add_flags

delete time in 9 days

delete branch MarkDaoust/io

delete branch : hide_core

delete time in 9 days

delete branch MarkDaoust/io

delete branch : docs-v0.10

delete time in 9 days

delete branch MarkDaoust/io

delete branch : logo

delete time in 9 days

delete branch MarkDaoust/io

delete branch : azure

delete time in 9 days

push eventMarkDaoust/io

Mark Daoust

commit sha 6c30203056a91fcfe9661f4a510e416d6600999a

Created using Colaboratory

view details

push time in 9 days

issue openedtensorflow/io

Publish azure notebook

Hi, I'm trying to execute the azure notebook for tensorflow.org

I get this error:

InternalError                             Traceback (most recent call last)
<ipython-input-5-0fe6a29d3aa3> in <module>
      1 pathname = 'az://{}/aztest'.format(account_name)
----> 2 tf.io.gfile.mkdir(pathname)
      3 
      4 filename = pathname + '/hello.txt'
      5 with tf.io.gfile.GFile(filename, mode='w') as w:

/tmpfs/src/tf_docs_env/lib/python3.5/site-packages/tensorflow_core/python/lib/io/file_io.py in create_dir_v2(path)
    423     errors.OpError: If the operation fails.
    424   """
--> 425   pywrap_tensorflow.CreateDir(compat.as_bytes(path))
    426 
    427 

InternalError: Failed to create directory az://devstoreaccount1/aztest (unknown_error - -598609368)

Any ideas?

created time in 10 days

pull request commenttensorflow/io

Add tfio.genome tutorial

published to tensorflow.org: https://www.tensorflow.org/io/tutorials/genome

suyashkumar

comment created time in 10 days

PR opened tensorflow/io

Fix azure notebook
try: 
    %tensorflow_version
+22 -9

0 comment

2 changed files

pr created time in 10 days

push eventMarkDaoust/io

Mark Daoust

commit sha ec6caa6be06df9af72f225df0f35975c82cd3ab5

Set private outputs.

view details

push time in 10 days

push eventMarkDaoust/io

Mark Daoust

commit sha 0615cdf87e36e9be850d4b2d9c527628f53327f3

clear outputs

view details

push time in 10 days

push eventMarkDaoust/io

Mark Daoust

commit sha 33fa924cad9b0de8dab6b9130487898cc2fbb1d6

Update README.md

view details

push time in 10 days

push eventMarkDaoust/io

push time in 10 days

push eventMarkDaoust/io

Mark Daoust

commit sha 73cdffc706d18f0767bfa95ba9ab633b4a3c1851

fix template link.

view details

push time in 10 days

push eventMarkDaoust/io

Mark Daoust

commit sha 9b05a5be3f3324fec95901abdaa4c91fbdb30408

try: %ten sorflow_version

view details

push time in 10 days

create barnchMarkDaoust/io

branch : azure

created branch time in 10 days

push eventMarkDaoust/io

Mark Daoust

commit sha 51d78ea7cea9e18732f6812d27f8f391ec48b9c6

TensorFlow.org Docs update for v0.10 (#718) * Created using Colaboratory * Created using Colaboratory * Remove local definitions filter * set private_outputs:true

view details

Mark Daoust

commit sha f12c90fe43a470f97e8a747d1a8fbbf9b6487211

Change logo link so this works on tf.org. (#720)

view details

pshiko

commit sha d6d9d13a05ae65ab32224d830d92bcc8d3ab606c

remove parallel_interleave from bigquery_api and reroute to `tf.data.Dataset.interleave` (#715) * remove parallel_interleave from bigquery_api parallel_interlave will be deprecated. * fix pylint

view details

Yong Tang

commit sha 8ae75c2ab3c05a126508086836b31f518c778ad1

Partially enable build for Travis CI cache Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 9834d134dda15fc7d726c89a30c37e056a97d9f2

Lower pylint to 1.9.4 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 84d3033ed3631126fe7add138c5163b958f72872

Revert "Lower pylint to 1.9.4" This reverts commit 9834d134dda15fc7d726c89a30c37e056a97d9f2.

view details

Yong Tang

commit sha 97d9bb31131eb68a8e873bb42af1914b06ccaf72

Revert "Partially enable build for Travis CI cache" This reverts commit 8ae75c2ab3c05a126508086836b31f518c778ad1.

view details

Yong Tang

commit sha b999240903bb71e14818fb3f2d8eb12bda75ada2

Bump tensorflow to 2.1.0 (#721) Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 28b9359b99b04e5e1d220e6d19ef61dc56600d07

Lower pylint to 1.9.4 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha aa7468a233d28e95c546ddb194400c7a44e6763a

Partially enable build for Travis CI cache Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 399ae2f513cddecf025ce6795104f8bdcad869f2

Batch 2 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 7032617c4598f1a4d2bc1800a6b01754379153cb

Batch 3 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 5a48064496d8dc7e5af87114d72d7d2e1e138290

Batch 4 Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha ed5bd0b0f5c8c4406376ada815dfdc31db9cc253

Batch 5 (build all) Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 65f0b074f95f4f60b6a95e6f98afebcaa90aed83

Enable all and tests Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha ae336bcac1b87d0e778d66e6786fbd31c745094a

Update Release note for v0.11.0 (#723) Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 7f2c9d3588aa6a2615260dac41a44449b06cd4ab

Comment out nightly, as it is not needed for release Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 69c602a9272eb15c3d87aa1eaa73fca17ab052a3

Add API reference badge (#725) Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha 50ebbf1133c8e1b5fe940d39016c04ca567059e7

Add GitHub Workflow CI status badge (#724) This PR adds GitHub Workflow CI status badge Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

Yong Tang

commit sha de84dea1a7238bc362de11fcb7b0d3e6fcf732b4

Remove Travis CI (#727) As v0.11.0 has been released, we could safely remove Travis CI (replaced with GitHub Actions). Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

view details

push time in 10 days

PR opened tensorflow/io

Remove tf_inspect patching.

This is no longer necessary, and no longer works.

+0 -6

0 comment

1 changed file

pr created time in 10 days

create barnchtensorflow/io

branch : MarkDaoust-patch-1

created branch time in 10 days

CommitCommentEvent

issue commenttensorflow/tensorflow

TFRecord guide doesn't show how to serialize and parse tensors

@MikeOfZen, IIUC tf.data.Snapshot will be the fix you're looking for.

Right @jsimsa?

But yes, it looks like we could use a section on tf.io.parse_tensor and tf.io.serialize_tensor either way.

bionicles

comment created time in 11 days

push eventsuyashkumar/io

Mark Daoust

commit sha 1bf03117124c0a786201d1050c25fd8295ffe1c9

Link fixes + print shapes.

view details

push time in 12 days

issue commenttensorflow/tensorflow

dataset_ops.py 'NoneType' object has no attribute 'device'

Hi.

I don't think this is:

  1. something to worry about, or
  2. an error that can be simply fixed.

These are all labeled "Exception ignored" is likely because the object is being deleted during python exit. See this answer:

https://stackoverflow.com/a/16620987/997378

This isn't interrupting a running program, right?

add import tensorflow as tf and line: 2944 and 3009 with ops.device(self._device): modify to with tf.device(self._device): It looks like it's solved

Thanks for the suggestion @kuzen. This might look like a fix but it isn't, really. This has something to do with object deletion order, I think during python exit.

Tensorflow files never import tensorflow as tf directly, they import the file that the object they want is implemented in. tf.device is implemented in /tensorflow/python/framework/ops.py.

kuzen

comment created time in 12 days

push eventryujaehun/tensorflow

Mark Daoust

commit sha d7e98863ddd36f0de30125e89991a1faaf80e266

Update writer.py

view details

push time in 13 days

Pull request review commenttensorflow/tensorflow

[DOC]: Update the docs regarding Variable.assign

 class VariableV1(Variable):   the variable are fixed. The value can be changed using one of the assign   methods. -  If you want to change the shape of a variable later you have to use an-  `assign` Op with `validate_shape=False`.+  If you want to change the shape of a variable later, this is only possible

Can you provide a working example?

Bharat123rox

comment created time in 13 days

pull request commenttensorflow/tensorflow

Fix Invalid description FileWriter

Thanks @ryujaehun,

I'll try merging this.

ryujaehun

comment created time in 13 days

push eventryujaehun/tensorflow

Mark Daoust

commit sha 2c3bd0f697ee828a097f6147c91f97fbad277f70

Update writer.py

view details

push time in 13 days

push eventryujaehun/tensorflow

Mark Daoust

commit sha 4d9e067fae2971ce6f8a3e90ab9a2e608cc60415

Update writer.py

view details

push time in 13 days

pull request commenttensorflow/tensorflow

[DOC]: Update the docs regarding Variable.assign

Hi @Bharat123rox,

Thanks for taking the time to make a PR, but this still doesn't look right.

Setting:

v = tf.Variable([1,2,3], validate_shape=False, shape=None)                                                                                                  
v.assign([1,2])          

gives:

ValueError: Shapes (3,) and (2,) are incompatible

You're editing VariableV1.... so maybe you were testing this in graph mode?

import tensorflow.compat.v1 as tf
tf.disable_v2_behavior()    
tf.Variable([1,2,3.], validate_shape=False, shape=None)
a = v.assign([1,2.])

Looks okay so far ... but all that's done is more the error to execution time instead of compile time

i = tf.global_variables_initializer()
with tf.Session() as sess:
  sess.run(i)
  sess.run(a)
  InvalidArgumentError: Assign requires shapes of both tensors to match. lhs shape= [3] rhs shape= [2]
  	 [[node Assign (defined at site-packages/tensorflow_core/python/framework/ops.py:1751) ]]

Do you have a working example? If not I'd just delete the line about changing the variable shape.

Bharat123rox

comment created time in 13 days

PR closed tensorflow/docs

Reviewers
Quick fix in text generation loop, fixes #36591 cla: yes

Remember all previously generated letters and use the string they form together as input for generating the next letter (instead of only considering the lastly generated letter).

+2 -1

5 comments

1 changed file

ndombe

pr closed time in 13 days

pull request commenttensorflow/docs

Quick fix in text generation loop, fixes #36591

Hi @ndombe,

Thanks for taking the time to make this PR.

But I do not think this change is correct.

  1. We're using a "stateful" RNN: unless you call .reset_states the network remembers it's state, it remembers what it's seen so far predicts the next step. It is not predicting just based on the last character input (note how this change does't increase the text quality).
  2. if we were not using a "stateful" RNN, the network would return an output, state pair. You can pass in the state in with the next input, so you con't need rerun the whole sequence to predict each letter.
  3. Passing the whole sequence to a "stateless-rnn" would work, but it would makes the runtime quadratic on the sequence length, you can see this by comparing the runtime of your version to the original.
ndombe

comment created time in 13 days

Pull request review commenttensorflow/io

Add a tutorial to create tf.data.Dataset from PostgreSQL database

+{+  "nbformat": 4,+  "nbformat_minor": 0,+  "metadata": {+    "colab": {+      "name": "postgresql.ipynb",+      "provenance": [],+      "collapsed_sections": [+        "Tce3stUlHN0L"+      ],+      "toc_visible": true+    },+    "kernelspec": {+      "name": "python3",+      "display_name": "Python 3"+    },+    "language_info": {+      "codemirror_mode": {+        "name": "ipython",+        "version": 3+      },+      "file_extension": ".py",+      "mimetype": "text/x-python",+      "name": "python",+      "nbconvert_exporter": "python",+      "pygments_lexer": "ipython3",+      "version": "3.6.3"+    }+  },+  "cells": [+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "Tce3stUlHN0L"+      },+      "source": [+        "##### Copyright 2020 The TensorFlow IO Authors."+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "cellView": "form",+        "colab_type": "code",+        "id": "tuOe1ymfHZPu",+        "colab": {}+      },+      "source": [+        "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n",+        "# you may not use this file except in compliance with the License.\n",+        "# You may obtain a copy of the License at\n",+        "#\n",+        "# https://www.apache.org/licenses/LICENSE-2.0\n",+        "#\n",+        "# Unless required by applicable law or agreed to in writing, software\n",+        "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",+        "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",+        "# See the License for the specific language governing permissions and\n",+        "# limitations under the License."+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "qFdPvlXBOdUN"+      },+      "source": [+        "# Create tf.data.Dataset from PostgreSQL database"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MfBg1C5NB3X0"+      },+      "source": [+        "<table class=\"tfo-notebook-buttons\" align=\"left\">\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://www.tensorflow.org/io/tutorials/postgresql\"><img src=\"https://www.tensorflow.org/images/tf_logo_32px.png\" />View on TensorFlow.org</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://colab.research.google.com/github/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/colab_logo_32px.png\" />Run in Google Colab</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://github.com/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/GitHub-Mark-32px.png\" />View source on GitHub</a>\n",+        "  </td>\n",+        "      <td>\n",+        "    <a href=\"https://raw.githubusercontent.com/tensorflow/io/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/download_logo_32px.png\" />Download notebook</a>\n",+        "  </td>\n",+        "</table>"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "xHxb-dlhMIzW"+      },+      "source": [+        "## Overview\n",+        "\n",+        "This tutorial shows how to create `tf.data.Dataset` from a PostgreSQL database server, so that the created `Dataset` could be passed to `tf.keras` for training or inference purposes.\n",+        "\n",+        "A SQL database is an important source of data for data scientist. As one of the most popular open source SQL database, [PostgreSQL](https://www.postgresql.org) is widely used in enterprises for storing critial and transactional data across the board. Creating `Dataset` from a PostgreSQL database server directly and pass the `Dataset` to `tf.keras` for training or inference, could greatly simplify the data pipeline and help data scientist to focus on building machine learning models."+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MUXex9ctTuDB"+      },+      "source": [+        "## Setup and usage"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "upgCc3gXybsA",+        "colab_type": "text"+      },+      "source": [+        "### Install required tensorflow-io packages, and restart runtime"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "uUDYyMZRfkX4",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "%tensorflow_version 2.x \n",+        "!pip install tensorflow-io-nightly"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "yZmI7l_GykcW",+        "colab_type": "text"+      },+      "source": [+        "### Install and setup PostgreSQL\n",+        "\n",+        "PostgreSQL database server is available on many platforms. In case it is not available, the following is needed to install PostgreSQL on Ubuntu:"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "YUj0878jPyz7",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!apt-get install -y -qq postgresql\n",

I need you to add a sudo here.

yongtang

comment created time in 15 days

Pull request review commenttensorflow/io

Add a tutorial to create tf.data.Dataset from PostgreSQL database

+{+  "nbformat": 4,+  "nbformat_minor": 0,+  "metadata": {+    "colab": {+      "name": "postgresql.ipynb",+      "provenance": [],+      "collapsed_sections": [+        "Tce3stUlHN0L"+      ],+      "toc_visible": true+    },+    "kernelspec": {+      "name": "python3",+      "display_name": "Python 3"+    },+    "language_info": {+      "codemirror_mode": {+        "name": "ipython",+        "version": 3+      },+      "file_extension": ".py",+      "mimetype": "text/x-python",+      "name": "python",+      "nbconvert_exporter": "python",+      "pygments_lexer": "ipython3",+      "version": "3.6.3"+    }+  },+  "cells": [+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "Tce3stUlHN0L"+      },+      "source": [+        "##### Copyright 2020 The TensorFlow IO Authors."+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "cellView": "form",+        "colab_type": "code",+        "id": "tuOe1ymfHZPu",+        "colab": {}+      },+      "source": [+        "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n",+        "# you may not use this file except in compliance with the License.\n",+        "# You may obtain a copy of the License at\n",+        "#\n",+        "# https://www.apache.org/licenses/LICENSE-2.0\n",+        "#\n",+        "# Unless required by applicable law or agreed to in writing, software\n",+        "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",+        "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",+        "# See the License for the specific language governing permissions and\n",+        "# limitations under the License."+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "qFdPvlXBOdUN"+      },+      "source": [+        "# Create tf.data.Dataset from PostgreSQL database"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MfBg1C5NB3X0"+      },+      "source": [+        "<table class=\"tfo-notebook-buttons\" align=\"left\">\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://www.tensorflow.org/io/tutorials/postgresql\"><img src=\"https://www.tensorflow.org/images/tf_logo_32px.png\" />View on TensorFlow.org</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://colab.research.google.com/github/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/colab_logo_32px.png\" />Run in Google Colab</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://github.com/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/GitHub-Mark-32px.png\" />View source on GitHub</a>\n",+        "  </td>\n",+        "      <td>\n",+        "    <a href=\"https://raw.githubusercontent.com/tensorflow/io/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/download_logo_32px.png\" />Download notebook</a>\n",+        "  </td>\n",+        "</table>"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "xHxb-dlhMIzW"+      },+      "source": [+        "## Overview\n",+        "\n",+        "This tutorial shows how to create `tf.data.Dataset` from a PostgreSQL database server, so that the created `Dataset` could be passed to `tf.keras` for training or inference purposes.\n",+        "\n",+        "A SQL database is an important source of data for data scientist. As one of the most popular open source SQL database, [PostgreSQL](https://www.postgresql.org) is widely used in enterprises for storing critial and transactional data across the board. Creating `Dataset` from a PostgreSQL database server directly and pass the `Dataset` to `tf.keras` for training or inference, could greatly simplify the data pipeline and help data scientist to focus on building machine learning models."+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MUXex9ctTuDB"+      },+      "source": [+        "## Setup and usage"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "upgCc3gXybsA",+        "colab_type": "text"+      },+      "source": [+        "### Install required tensorflow-io packages, and restart runtime"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "uUDYyMZRfkX4",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "%tensorflow_version 2.x \n",+        "!pip install tensorflow-io-nightly"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "yZmI7l_GykcW",+        "colab_type": "text"+      },+      "source": [+        "### Install and setup PostgreSQL\n",+        "\n",+        "PostgreSQL database server is available on many platforms. In case it is not available, the following is needed to install PostgreSQL on Ubuntu:"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "YUj0878jPyz7",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!apt-get install -y -qq postgresql\n",+        "\n",+        "!service postgresql start"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "Afb01zkACsuW",+        "colab_type": "text"+      },+      "source": [+        "PostgreSQL will setup a user with username `postgres` by default. However, this username is not assigned a password initially. We will need to update the database first. The following assigns password `postgres` to username `postgres`:"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "3HHfVdv9D3Jv",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!sudo -u postgres psql -U postgres -c \"ALTER USER postgres PASSWORD 'postgres';\""+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "9reCVv0mE_9O",+        "colab_type": "text"+      },+      "source": [+        "### Create database and prepare data\n",+        "\n",+        "For demo purposes we will create a database and populate the database with some data. The data we use are the stock prices of AAPL in 2019, downloaded from Yahoo Finance in [CSV format](https://github.com/tensorflow/io/blob/master/docs/tutorials/postgresql/aapl.csv). The following is a sneak preview of the CSV data:\n",

I don't think I can publish it like this.

Can you try to find a dataset with a clear open-license?

I believe anything from: https://archive.ics.uci.edu/ml/index.php is okay.

yongtang

comment created time in 15 days

Pull request review commenttensorflow/io

Add a tutorial to create tf.data.Dataset from PostgreSQL database

+{+  "nbformat": 4,+  "nbformat_minor": 0,+  "metadata": {+    "colab": {+      "name": "postgresql.ipynb",+      "provenance": [],+      "collapsed_sections": [+        "Tce3stUlHN0L"+      ],+      "toc_visible": true+    },+    "kernelspec": {+      "name": "python3",+      "display_name": "Python 3"+    },+    "language_info": {+      "codemirror_mode": {+        "name": "ipython",+        "version": 3+      },+      "file_extension": ".py",+      "mimetype": "text/x-python",+      "name": "python",+      "nbconvert_exporter": "python",+      "pygments_lexer": "ipython3",+      "version": "3.6.3"+    }+  },+  "cells": [+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "Tce3stUlHN0L"+      },+      "source": [+        "##### Copyright 2020 The TensorFlow IO Authors."+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "cellView": "form",+        "colab_type": "code",+        "id": "tuOe1ymfHZPu",+        "colab": {}+      },+      "source": [+        "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n",+        "# you may not use this file except in compliance with the License.\n",+        "# You may obtain a copy of the License at\n",+        "#\n",+        "# https://www.apache.org/licenses/LICENSE-2.0\n",+        "#\n",+        "# Unless required by applicable law or agreed to in writing, software\n",+        "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",+        "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",+        "# See the License for the specific language governing permissions and\n",+        "# limitations under the License."+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "qFdPvlXBOdUN"+      },+      "source": [+        "# Create tf.data.Dataset from PostgreSQL database"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MfBg1C5NB3X0"+      },+      "source": [+        "<table class=\"tfo-notebook-buttons\" align=\"left\">\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://www.tensorflow.org/io/tutorials/postgresql\"><img src=\"https://www.tensorflow.org/images/tf_logo_32px.png\" />View on TensorFlow.org</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://colab.research.google.com/github/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/colab_logo_32px.png\" />Run in Google Colab</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://github.com/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/GitHub-Mark-32px.png\" />View source on GitHub</a>\n",+        "  </td>\n",+        "      <td>\n",+        "    <a href=\"https://raw.githubusercontent.com/tensorflow/io/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/download_logo_32px.png\" />Download notebook</a>\n",+        "  </td>\n",+        "</table>"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "xHxb-dlhMIzW"+      },+      "source": [+        "## Overview\n",+        "\n",+        "This tutorial shows how to create `tf.data.Dataset` from a PostgreSQL database server, so that the created `Dataset` could be passed to `tf.keras` for training or inference purposes.\n",+        "\n",+        "A SQL database is an important source of data for data scientist. As one of the most popular open source SQL database, [PostgreSQL](https://www.postgresql.org) is widely used in enterprises for storing critial and transactional data across the board. Creating `Dataset` from a PostgreSQL database server directly and pass the `Dataset` to `tf.keras` for training or inference, could greatly simplify the data pipeline and help data scientist to focus on building machine learning models."+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MUXex9ctTuDB"+      },+      "source": [+        "## Setup and usage"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "upgCc3gXybsA",+        "colab_type": "text"+      },+      "source": [+        "### Install required tensorflow-io packages, and restart runtime"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "uUDYyMZRfkX4",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "%tensorflow_version 2.x \n",+        "!pip install tensorflow-io-nightly"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "yZmI7l_GykcW",+        "colab_type": "text"+      },+      "source": [+        "### Install and setup PostgreSQL\n",+        "\n",+        "PostgreSQL database server is available on many platforms. In case it is not available, the following is needed to install PostgreSQL on Ubuntu:"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "YUj0878jPyz7",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!apt-get install -y -qq postgresql\n",+        "\n",+        "!service postgresql start"+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "Afb01zkACsuW",+        "colab_type": "text"+      },+      "source": [+        "PostgreSQL will setup a user with username `postgres` by default. However, this username is not assigned a password initially. We will need to update the database first. The following assigns password `postgres` to username `postgres`:"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "3HHfVdv9D3Jv",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "!sudo -u postgres psql -U postgres -c \"ALTER USER postgres PASSWORD 'postgres';\""

IDK postgress. But please confirm that we're not going to break someone's local installation if they run this notebook.

If there is a chance this will break people we need a big red warning at the top:

> Warning: *This notebook is designed to be run in a Google Colab only*. It installs packages on the system and requires root access. If you want to run it in a local Jupyter notebook, please proceed with caution.
yongtang

comment created time in 15 days

Pull request review commenttensorflow/io

Add a tutorial to create tf.data.Dataset from PostgreSQL database

+{+  "nbformat": 4,+  "nbformat_minor": 0,+  "metadata": {+    "colab": {+      "name": "postgresql.ipynb",+      "provenance": [],+      "collapsed_sections": [+        "Tce3stUlHN0L"+      ],+      "toc_visible": true+    },+    "kernelspec": {+      "name": "python3",+      "display_name": "Python 3"+    },+    "language_info": {+      "codemirror_mode": {+        "name": "ipython",+        "version": 3+      },+      "file_extension": ".py",+      "mimetype": "text/x-python",+      "name": "python",+      "nbconvert_exporter": "python",+      "pygments_lexer": "ipython3",+      "version": "3.6.3"+    }+  },+  "cells": [+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "Tce3stUlHN0L"+      },+      "source": [+        "##### Copyright 2020 The TensorFlow IO Authors."+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "cellView": "form",+        "colab_type": "code",+        "id": "tuOe1ymfHZPu",+        "colab": {}+      },+      "source": [+        "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n",+        "# you may not use this file except in compliance with the License.\n",+        "# You may obtain a copy of the License at\n",+        "#\n",+        "# https://www.apache.org/licenses/LICENSE-2.0\n",+        "#\n",+        "# Unless required by applicable law or agreed to in writing, software\n",+        "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",+        "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",+        "# See the License for the specific language governing permissions and\n",+        "# limitations under the License."+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "qFdPvlXBOdUN"+      },+      "source": [+        "# Create tf.data.Dataset from PostgreSQL database"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MfBg1C5NB3X0"+      },+      "source": [+        "<table class=\"tfo-notebook-buttons\" align=\"left\">\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://www.tensorflow.org/io/tutorials/postgresql\"><img src=\"https://www.tensorflow.org/images/tf_logo_32px.png\" />View on TensorFlow.org</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://colab.research.google.com/github/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/colab_logo_32px.png\" />Run in Google Colab</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://github.com/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/GitHub-Mark-32px.png\" />View source on GitHub</a>\n",+        "  </td>\n",+        "      <td>\n",+        "    <a href=\"https://raw.githubusercontent.com/tensorflow/io/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/download_logo_32px.png\" />Download notebook</a>\n",+        "  </td>\n",+        "</table>"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "xHxb-dlhMIzW"+      },+      "source": [+        "## Overview\n",+        "\n",+        "This tutorial shows how to create `tf.data.Dataset` from a PostgreSQL database server, so that the created `Dataset` could be passed to `tf.keras` for training or inference purposes.\n",+        "\n",+        "A SQL database is an important source of data for data scientist. As one of the most popular open source SQL database, [PostgreSQL](https://www.postgresql.org) is widely used in enterprises for storing critial and transactional data across the board. Creating `Dataset` from a PostgreSQL database server directly and pass the `Dataset` to `tf.keras` for training or inference, could greatly simplify the data pipeline and help data scientist to focus on building machine learning models."+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MUXex9ctTuDB"+      },+      "source": [+        "## Setup and usage"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "id": "upgCc3gXybsA",+        "colab_type": "text"+      },+      "source": [+        "### Install required tensorflow-io packages, and restart runtime"+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "id": "uUDYyMZRfkX4",+        "colab_type": "code",+        "colab": {}+      },+      "source": [+        "%tensorflow_version 2.x \n",

Please update this so it works outside of Colab:

try:
  %tensorflow_version 2.x
except Exception:
  pass
```
yongtang

comment created time in 15 days

Pull request review commenttensorflow/io

Add a tutorial to create tf.data.Dataset from PostgreSQL database

+{+  "nbformat": 4,+  "nbformat_minor": 0,+  "metadata": {+    "colab": {+      "name": "postgresql.ipynb",+      "provenance": [],+      "collapsed_sections": [+        "Tce3stUlHN0L"+      ],+      "toc_visible": true+    },+    "kernelspec": {+      "name": "python3",+      "display_name": "Python 3"+    },+    "language_info": {+      "codemirror_mode": {+        "name": "ipython",+        "version": 3+      },+      "file_extension": ".py",+      "mimetype": "text/x-python",+      "name": "python",+      "nbconvert_exporter": "python",+      "pygments_lexer": "ipython3",+      "version": "3.6.3"+    }+  },+  "cells": [+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "Tce3stUlHN0L"+      },+      "source": [+        "##### Copyright 2020 The TensorFlow IO Authors."+      ]+    },+    {+      "cell_type": "code",+      "metadata": {+        "cellView": "form",+        "colab_type": "code",+        "id": "tuOe1ymfHZPu",+        "colab": {}+      },+      "source": [+        "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n",+        "# you may not use this file except in compliance with the License.\n",+        "# You may obtain a copy of the License at\n",+        "#\n",+        "# https://www.apache.org/licenses/LICENSE-2.0\n",+        "#\n",+        "# Unless required by applicable law or agreed to in writing, software\n",+        "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",+        "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",+        "# See the License for the specific language governing permissions and\n",+        "# limitations under the License."+      ],+      "execution_count": 0,+      "outputs": []+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "qFdPvlXBOdUN"+      },+      "source": [+        "# Create tf.data.Dataset from PostgreSQL database"+      ]+    },+    {+      "cell_type": "markdown",+      "metadata": {+        "colab_type": "text",+        "id": "MfBg1C5NB3X0"+      },+      "source": [+        "<table class=\"tfo-notebook-buttons\" align=\"left\">\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://www.tensorflow.org/io/tutorials/postgresql\"><img src=\"https://www.tensorflow.org/images/tf_logo_32px.png\" />View on TensorFlow.org</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://colab.research.google.com/github/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/colab_logo_32px.png\" />Run in Google Colab</a>\n",+        "  </td>\n",+        "  <td>\n",+        "    <a target=\"_blank\" href=\"https://github.com/tensorflow/io/blob/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/GitHub-Mark-32px.png\" />View source on GitHub</a>\n",+        "  </td>\n",+        "      <td>\n",+        "    <a href=\"https://raw.githubusercontent.com/tensorflow/io/master/docs/tutorials/postgresql.ipynb\"><img src=\"https://www.tensorflow.org/images/download_logo_32px.png\" />Download notebook</a>\n",

https://storage.googleapis.com/tensorflow_docs/io/docs/tutorials/postgresql.ipynb

yongtang

comment created time in 15 days

Pull request review commenttensorflow/io

Add a tutorial to create tf.data.Dataset from PostgreSQL database

 toc: - title: "BigQuery"   path: /io/tutorials/bigquery+- title: "Create tf.data.Dataset from PostgreSQL database"

I usually try to keep these titles short. They're easiest to read if they fit on a single line.

But NBD either way.

yongtang

comment created time in 15 days

pull request commenttensorflow/docs

add `tf.` for prediction_layer in `/tutorials/images/transfer_learning`

Tip: if you update the branch it updated the PR. so you don't need to close and make a new one.

But do whatever works for you.

jangsoopark

comment created time in 15 days

pull request commenttensorflow/docs

Typo fix

Thanks!

stabuev

comment created time in 15 days

push eventMarkDaoust/addons

Mark Daoust

commit sha 4405763148b1a94ff36c796879ff2359616dd202

Fix Flake8: remove unused imports

view details

push time in 15 days

PR opened tensorflow/addons

Add to toc

Add seq2seq to TOC and fix the api-generator.

+2 -3

0 comment

2 changed files

pr created time in 15 days

push eventMarkDaoust/addons

Mark Daoust

commit sha bebfecb1aeaf56df532e8b97d206e57af66a4f3b

typo

view details

push time in 15 days

create barnchMarkDaoust/addons

branch : add_to_toc

created branch time in 15 days

push eventMarkDaoust/addons

push time in 15 days

issue commenttensorflow/tensorflow

tf.keras.layers.Input has undefined shape when setting sparse=True, making it impossible to use in a Model

I've fixed this in 74195b50fb5e1f22eb95ffd1646b4b0ceca2ea9b, #23748

danielegrattarola

comment created time in 15 days

PR opened tensorflow/addons

Fix lazyadam notebook json
+1 -1

0 comment

1 changed file

pr created time in 16 days

push eventMarkDaoust/addons

Mark Daoust

commit sha 1158da3c631d49f7d2eea207b2b398895c66e3ee

fix json?

view details

push time in 16 days

push eventMarkDaoust/addons

Mark Daoust

commit sha 8d768db8cb31783612246ce85e72e15cfd00ebe8

Update site (#840) * Some fixes for republishing tensorflow.org

view details

Tzu-Wei Sung

commit sha 06d686e8859a3c6496f81ba8ee9b6247a12282bb

FIX: GELU name (#843) * FIX: GELU name

view details

Daniel

commit sha 2b84e03933c0176f89e2c35fa1a344a7fa5aaaff

Fix bug in "xy" mode for bilinear interpolation (#845) * Fix bug in "xy" mode for bilinear interpolation * fixed error in interp implementation, and added test for non-square images. * removed erroneous non-square test, and modified small_grid tests to be non-square.

view details

Sean Morgan

commit sha 81d75ec27c4fcb9aa095f511eb6a4b6965eba28e

Add broken tutorial do docs for testing verification (#832)

view details

Sean Morgan

commit sha 0b11bc55f91f3ea0c9c80a55f831005192c49f70

CLN: Remove sanity nightly badge (#850)

view details

Sean Morgan

commit sha 1345091f328d1b03bade72f92cd22fdc71178989

DOC: Update build matrix (#849)

view details

Sean Morgan

commit sha 2bcf8c874b18b88f454a758e0f64b959c8543fda

Increment minor version to 0.8 (#848)

view details

Shreyash Patodia

commit sha 10ccec38321cd8d93bd5cf13bea0479ac1d8fbc1

Add Novograd Optimizer (#836) * Add initial novograd * Add tests from rectified adam * Add build and __init__ * Code format * Fix errors * More fixes * Add back one - beta_1_t * Fix some sparse errors * Fix some sparse errors * More fixes * More sparse fixes * Change tests * Fix ordering * More test fixes * Account for learning rate * Fix error * Sparse fix * Fix weight decay dense * More complete testing for desne resource apply * Add linear model test * Increase number of epochs for novograd * Increae error threshold * More epochs * More linear updates * More changes to linear test * Update another dense test * Tests * Revert change to swa_test * Possibly fix all tests * Documentation and cleanup * Attempt to reduce tolerance for linear test * Reduce even further * Even further * Pushed as far as possible * Pylint and sanity check * More epochs and change beta_1 and beta_2 * More epochs and change beta_1 and beta_2 * More epochs and change beta_1 and beta_2 * Fix typo * Make current values more important * Make current values more important * Increase threshold * Remove learning rate * Update tests * Update other tests * Update grad_averaging logic * Update grad_averaging logic * Add amsgrad * Tests update * Tests update * Tests update * Code format * Code format * Use keras training ops * Address comments * Address comments * Tests for grad_averaging * Fix grad_averaging test * Test fix * Change default epsilon value * Fix code format * docs: add TODO

view details

Ulf Hamster

commit sha 1c45a344cb12a18d82df955777fb53358fc3dd0b

sanity checks for Github Actions (#858) * Sanity check ran on Github Actions

view details

Sean Morgan

commit sha 75573ac64099d545fd42b5ff7cab8a816f296fab

Move ubuntu CPU testing to github actions (#862) * Move ubuntu CPU testing to github actions * Typo

view details

Tzu-Wei Sung

commit sha 859e7cf7cdbe33e152cb66112b335af0f053fe7a

CLN: define _USE_MATH_DEFINES for windows build (#867)

view details

Aakash Kumar Nain

commit sha 8b08fc4bbac169020628d5805943a848d2cb098b

Thresholded Linear Unit (#857)

view details

Sean Morgan

commit sha 120f7f849fe1fd1fd8c5596012d01bae64b09e15

Consolidate test case label (#872)

view details

Sean Morgan

commit sha c4c9b1acd3dcdee23336f734052434c6f49bd54a

DOC: update tutorial versions (#871) * Update image_ops.ipynb * Update layers_normalizations.ipynb * Update layers_weightnormalization.ipynb * Update losses_triplet.ipynb * Update networks_seq2seq_nmt.ipynb * Update optimizers_conditionalgradient.ipynb * Update optimizers_lazyadam.ipynb * Delete temp_broken_tutorial.ipynb * Update time_stopping.ipynb * Update tqdm_progress_bar.ipynb

view details

Dheeraj R Reddy

commit sha e3e94efe2caf3ef5ef79120ae2263efa01dbcff5

Add multi-device testing utils (#842)

view details

Romain Brault

commit sha a1a1e4c86e70389b36587c9fa2d5c188f613b2ce

Add Pinball Loss (#579) * correction, typeError (#545) * correction, typeError * revise * add test * add typeerror * sanity indentation * get rid of the first for loop * test filter shape * remove unnecessary * minor Docs update for tensorflow.org (#578) * Simplify yaml files. * Add tensorflow.org buttons * switch imports to %tensorflow_version * switch tensorflow_version before installing addons * Switch to one of our images * Test-run in Colab * Add try/except for colab * verbose = 2 * Use --no-deps * Update template, clear output * add download links pinball tests: alpha -> tau pinball tests: alpha -> tau list files passing loss tests passing all tests refs public API typo imports doc metric to mean pinball tests: alpha -> tau pinball tests: alpha -> tau list files passing loss tests passing all tests refs public API typo imports doc metric to mean pinball loss reformat removed tf.function pylint readme rename module + __init__ rename module + __init__ deletions correction, typeError (#545) * correction, typeError * revise * add test * add typeerror * sanity indentation * get rid of the first for loop * test filter shape * remove unnecessary * minor Docs update for tensorflow.org (#578) * Simplify yaml files. * Add tensorflow.org buttons * switch imports to %tensorflow_version * switch tensorflow_version before installing addons * Switch to one of our images * Test-run in Colab * Add try/except for colab * verbose = 2 * Use --no-deps * Update template, clear output * add download links pinball tests: alpha -> tau pinball tests: alpha -> tau list files passing loss tests passing all tests refs public API typo imports doc metric to mean pinball tests: alpha -> tau pinball tests: alpha -> tau list files passing loss tests passing all tests refs public API typo imports doc metric to mean pinball loss reformat removed tf.function pylint readme rename module + __init__ rename module + __init__ deletions mrg mrg quantiles deps deps deletions deletions quantiles * quantiles * typo * typo * modifs * spacing * typo * typo * typo * code format * requires modifs * requires modifs * doc * tau * tau * tau * doc + tests

view details

Aakash Kumar Nain

commit sha cdf9de56a971e2dd5b498210f901cf839b64a0c0

fix naming for GELU and add tlu maintainer (#874)

view details

Sean Morgan

commit sha 0a23fd2dc41be4725da27e8f68ddfb71cef72bc1

Fix Yogi import (#875)

view details

Gabriel de Marmiesse

commit sha 9e13d30abd92b8514faccef0b8db2a32b3f4cf41

Lazy loading of shared libraries. (#869) * Added lazy loading

view details

Gabriel de Marmiesse

commit sha 20fd00d48911b8829c7869c387ffef2e02f943e4

Dropping the python 2 builds. (#861) * Dropping the python 2 builds. * Removed some py2 and __future__ checks. * Removed the python version option in do_pylint.

view details

push time in 16 days

IssuesEvent

issue commenttensorflow/tensorflow

tensorflow.keras Dense layers complain if the input is a sparse Input layer.

Hi @karmel,

I just submitted the fix for this. It should be synced out shortly.

JamesGlooTeam

comment created time in 16 days

issue commenttensorflow/tensorflow

Broken outbound links from index pages for older TF API

Acknowledged.

This is my fault. I'll make sure it doesn't happen going forward, but IDK how many of the old snap-shots I can fix.

lichili233

comment created time in 16 days

pull request commenttensorflow/docs

fix save_and_serialize.ipynb

Hi beginner30,

Usually when the bot does this it's because the email address in the commits is not the same as the email address on the github account.

Check your $ git config user.email, and be sure you have the same one set in your github account settings.

Use $ git config --global user.email johndoe@example.com to set it.

See this article for more about how these commands work: https://git-scm.com/book/en/v2/Getting-Started-First-Time-Git-Setup

beginner30

comment created time in 16 days

more