DecstionBack

Stay Hungry. Stay Foolish.

[paper Reading Bert] Bert: Pre Training Of Deep Bidirectional Transformers For Language Understanding

Posted by DecstionBack on November 28, 2018

[paper Reading] Improving Language Understanding By Generative Pretraining

Background Although large unlabeled text corpora are abundant, labeled data for learning these specific tasks is scare, making it challenging for discriminatively trained models to perform...

Posted by DecstionBack on November 27, 2018

[paper Reading 2018 Naacl Best Paper] Deep Contextualized Word Representations

Background Pre-trained word representations are a key component in many natural language understanding models. However, learning high quality representations can be challenging. They should ide...

Posted by DecstionBack on November 27, 2018

[book Reading] Question Answering 段楠 周明

第1章 概述 历史沿革 智能问答(Question Answering, QA)旨在为用户提出的自然语言问题自动提供答案。 应用场景有搜索引擎、智能语音助手等。 受限领域问答 早期智能问答系统大都针对特定领域构建，并且需要领域专家撰写大量领域相关的规则用于问题理解和答案生成，这极大地限制了该类智能问答系统地规模和通用性。此外，受限于自然语言处理水平和计算机的运算能力，这类系统的准确度...

Posted by DecstionBack on November 26, 2018

[paper Reading] Nips 2017 Attention Is All You Need

Background and Motivation Background RNNs have been firmly established as state of the art approaches in sequence modeling and transduction problem such as language modeling and ma...

Posted by DecstionBack on November 24, 2018

Ubuntu碎碎念

创建sudo用户 sudo adduser username 会自动提示输入密码等操作. 将用户赋予sudo权限 sudo vim /etc/sudoers 加入 username ALL=(ALL) ALL 本机开启ssh连接权限 apt-get install openssh-server /etc/init.d/ssh start

Posted by DecstionBack on November 24, 2018

上google Shcolar科研

服务器端配置ss-libev 安装出问题参考: vultr登上谷歌学术 安装ss-libev sudo apt-get install software-properties-common -y sudo add-apt-repository ppa:max-c-lv/shadowsocks-libev -y sudo apt-get update sudo apt install s...

Posted by DecstionBack on November 22, 2018