Skip to Main content Open mobile menu Close mobile menu
Understanding attention in large language models
  1. Understanding attention in large language models

    How do chatbots based on the transformer architecture decide what to pay attention to in a conversation? They’ve made their own machine learning algorithms to tell them.

    The post Understanding attention in large language models appeared first on Michigan Engineering News.

  2. Biases in large image-text AI model favor wealthier, Western perspectives

    AI model that pairs text, images performs poorly on lower-income or non-Western images, potentially increasing inequality in digital technology representation.

    The post Biases in large image-text AI model favor wealthier, Western perspectives appeared first on Michigan Engineering News.

  3. Nextgen computing: Hard-to-move quasiparticles glide up pyramid edges

    Computing with a combination of light and chargeless excitons could beat heat losses and more, but excitons need new modes of transport.

    The post Nextgen computing: Hard-to-move quasiparticles glide up pyramid edges appeared first on Michigan Engineering News.

  4. $18M to advance materials research for quantum computing, sustainable plastics and more

    New center builds a campus-wide ecosystem for designing and manufacturing materials of the future at U-M while training a more representative workforce.

    The post $18M to advance materials research for quantum computing, sustainable plastics and more appeared first on Michigan Engineering News.

  5. Optimization could cut the carbon footprint of AI training by up to 75%

    Deep learning models that power giants like TikTok and Amazon, as well as tools like ChatGPT, could save energy without new hardware or infrastructure.

    The post Optimization could cut the carbon footprint of AI training by up to 75% appeared first on Michigan Engineering News.

  6. Scalable method to manufacture thin film transistors achieves ultra-clean interface for high performance, low-voltage device operation

    Led by Prof. Becky Peterson, the research focuses on a category of materials important for low power logic operations, high pixel density screens, touch screens, and haptic displays.

    The post Scalable method to manufacture thin film transistors achieves ultra-clean interface for high performance, low-voltage device operation appeared first on Michigan Engineering News.

  7. Six ECE faculty will help shape the future of semiconductors as part of the JUMP 2.0 program

    Elaheh Ahmadi, David Blaauw, Michael Flynn, Hun-Seok Kim, Hessam Mahdavifar, and Zhengya Zhang bring their expertise and creativity to this nationwide undertaking in the area of semiconductors and information & communication technologies.

    The post Six ECE faculty will help shape the future of semiconductors as part of the JUMP 2.0 program appeared first on Michigan Engineering News.

  8. Open-source hardware: a growing movement to democratize IC design

    Dr. Mehdi Saligane, a leader in the open-source chip design community, was among the first researchers to fabricate a successful chip as part of Google’s multi-project wafer program.

    The post Open-source hardware: a growing movement to democratize IC design appeared first on Michigan Engineering News.

  9. Duraisamy to lead Michigan Institute for Computational Discovery and Engineering

    “I am looking forward to working with the incredible talent we have at U-M to expand the frontiers of computational science, and in more firmly establishing the role of computing in solving the grand challenge problems facing humanity.”

    The post Duraisamy to lead Michigan Institute for Computational Discovery and Engineering appeared first on Michigan Engineering News.

  10. Seeing electron movement at fastest speed ever could help unlock next-level quantum computing

    New technique could enable processing speeds a million to a billion times faster than today’s computers and spur progress in many-body physics.

    The post Seeing electron movement at fastest speed ever could help unlock next-level quantum computing appeared first on Michigan Engineering News.