Back to : ml-study
Contents

What is Machine Learning?

  • A. Samuel (1959) : ์ปดํ“จํ„ฐ๊ฐ€ explicitly program ๋˜์ง€ ์•Š์€ ๋‚ด์šฉ์„ ํ•™์Šตํ•˜๊ฒŒ ํ•˜๋Š” ๋ถ„์•ผ
  • T. Mitchell (1998) : Task T, Performance measure P, Experience E๊ฐ€ ์žˆ๊ณ , E์— ์˜ํ•ด P๊ฐ€ ๋ฐœ์ „ํ•˜๋Š” Learning problem.
  • Supervised / Unsupervised Learning
  • Reinforcement Learning, Recommenders, โ€ฆ

์‘์šฉ ๋ถ„์•ผ

  • Web search, photo tagging, etcโ€ฆ
  • ์ปดํ“จํ„ฐ์—๊ฒŒ ์ œ๊ณต๋˜๋Š” ์ƒˆ๋กœ์šด ๊ฐ€๋Šฅ์„ฑ - ์ธ๊ฐ„์˜ ์‚ฌ๊ณ /ํ•™์Šตํ•˜๋Š” ๋ฐฉ์‹ ๋ชจ๋ฐฉํ•˜์—ฌ ์ž‘๋™.
    • Database mining (web click, medical records, โ€ฆ)
      • Computational biology, ์œ ์ „์ž ๋ถ„์„ ๋“ฑ.
    • ์ง์ ‘ ํ”„๋กœ๊ทธ๋ž˜๋ฐํ•  ์ˆ˜ ์—†๋Š” ๋ฌธ์ œ๋“ค
      • ์ž์œจ์ฃผํ–‰ ๊ธฐ์ˆ  - How?
      • Handwriting recognition
      • Natural Language Processing
    • Self customizing
      • ๊ฐœ๋ณ„ ์œ ์ €์— ๋Œ€ํ•ด customized๋œ ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๊ฐœ๋ฐœ
    • Understanding Brains / Human Learning

Supervised Learning

  • ์˜ฌ๋ฐ”๋ฅธ ์ •๋‹ต ์ด ์ฃผ์–ด์ง€๋Š” Learning problem.
  • ์˜ฌ๋ฐ”๋ฅธ ์ •๋‹ต ์ฒ˜๋Ÿผ ํ–‰๋™ํ•˜๋Š” ํ”„๋กœ๊ทธ๋žจ ๋งŒ๋“ค๊ธฐ.
  • ex) ์ฃผํƒ ๊ฐ€๊ฒฉ์˜ ์˜ˆ์ธก. ์–ด๋–ป๊ฒŒ ์ด ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•  ๊ฒƒ์ธ๊ฐ€?
    • ์ผ์ฐจํ•จ์ˆ˜ ํ”ผํŒ…? ์ด์ฐจํ•จ์ˆ˜ ํ”ผํŒ…?
    • Regression Problem (์—ฐ์†์ ์ธ ๊ฐ’ ์˜ˆ์ธกํ•˜๊ธฐ)
  • ex) ์ข…์–‘ ํฌ๊ธฐ($x$)์— ๋”ฐ๋ฅธ ์–‘์„ฑ / ์•…์„ฑ ($y$) ์˜ˆ์ธก.
    • Probability ์˜ˆ์ธกํ•˜๊ธฐ.
    • Classification Problem (์ด์‚ฐ์ ์ธ ๊ฐ’์— ๋Œ€ํ•œ ํ™•๋ฅ )
    • Seperating Line ์ฐพ๊ธฐ.
  • ๋ช‡๊ฐœ์˜ Feature์— ๋Œ€ํ•ด ์ฐพ์„ ๊ฒƒ์ธ๊ฐ€?
  • Support Vector Machine - Infinite number of feature์— ๋Œ€ํ•ด์„œ๋„ ๋Œ€์‘ํ•  ์ˆ˜ ์žˆ๋Š” ์ˆ˜ํ•™์ ์ธ ๋ฐฉ๋ฒ•.

Unsupervised Learning

  • ์˜ฌ๋ฐ”๋ฅธ ์ •๋‹ต ์ด ์ฃผ์–ด์ง€์ง€ ์•Š๋Š” Learning Problem
  • Clustering algorithm
    • ex) Google News : ์ˆ˜๋งŽ์€ ๋‰ด์Šค๋ฅผ AUTOMATICALLY ๊ฐ ์ฃผ์ œ๋ณ„๋กœ ๋ชจ์•„์„œ ๋ณด์—ฌ์ฃผ๋Š” ์„œ๋น„์Šค ์ œ๊ณต.
    • ex) Genomics : ์œ ์ „์ž ์ •๋ณด๋ฅผ ์ด์šฉํ•œ clustering
    • Astronomical data, SNS Analysis, Computing cluster organizing, Market segmentation โ€ฆ
  • ex) Cocktail Party Problem : ๊ฒน์น˜๋Š” ๋ชฉ์†Œ๋ฆฌ ๊ตฌ๋ถ„ํ•ด ๋‚ด๋Š” ๋ฌธ์ œ.
    • ์งง๊ณ  ๊ฐ„๊ฒฐํ•œ ์ฝ”๋“œ๋กœ ์œ ์˜๋ฏธํ•œ ๊ฒฐ๊ณผ ๋„์ถœ ๊ฐ€๋Šฅ.
    • ์ด ๊ฐ•์˜์—์„œ๋Š” Octave ์ด์šฉ.