본문 바로가기

강의14

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 강의 항목에 들어갈 내용은 아니지만.. 졸논을 위한 BERT 복습 BERT는 무엇인가? Bidirectional Encoder Representations from Transformers (BERT) Task-specific parameter를 최소한으로 하여 pre-trained parameter를 fine-tuning만 해서 사용할 수 있는 representation model (fine-tuning approach) (이는 trained model의 output representation을 사용하는 feature-based approach와 대조된다.) 따라서 BERT를 거의 건드릴 필요 없이 layer 하나만 BERT위에 얹어주어 필요한 task에 맞게 fine-tuning만 조금 해주면 된다. .. 2022. 11. 17.
2. Modern SQL Relational algebra is based on sets (unordered, no duplicates). SQL is based on bags (unordered, allows duplicates). SQL History SQL is comprised of different classes of commands: Data Manipulation Language (DML): SELECT, INSERT, UPDATE, and DELETE statements. Data Definition Language (DDL): Schema definitions for tables, indexes, views, and other objects. Data Control Language (DCL): Security, .. 2022. 11. 15.
1. Relational Model & Relational Algebra Database - an organized collection of inter-related data that models some aspects of the real-world (e.g., modeling the students in a class or a digital music store) DBMS (DataBase Management System) - a software that allows applications to store and analyze information in a database (e.g. MySQL, Oracle, MongoDB, Snowflake, ...) A general-purpose DBMS is designed to allow the definition, creatio.. 2022. 11. 14.
0. Preview Reference: CMU 15-445/645 (Fall 2022) Schedule - CMU 15-445/645 :: Intro to Database Systems (Fall 2022) Course schedule with slides, lecture notes, and videos. 15445.courses.cs.cmu.edu 2022. 11. 14.