1. Memory Addressing System Utilizing Multi-Level Granular Hashing for Device Distribution

Apple Inc., 2023

Memory addressing technique for distributing a large memory address space across multiple memory devices in a computer system. The technique uses hashing to select the memory device based on subsets of address bits at multiple levels of granularity. This allows flexible mapping of addresses to devices while optimizing performance by distributing accesses across devices. It also enables dynamic disabling of devices for maintenance while preserving frequently accessed data.

2. Hardware Accelerator with Power-Gated Local Memory and Non-Volatile Data Retention

Apple Inc., 2023

Hardware accelerators with power-gated local memory to reduce power consumption. The accelerator and memory can be powered down between iterations to save power. However, reusable data like constants and instruction words are stored in non-volatile memory while volatile memory holds varying data. This allows initializing the non-volatile memory once then reusing it without needing to load it each iteration. The volatile memory is powered off between iterations.

3. Neural Processor with Integrated Neural and Planar Engine Circuits for Input Management

Apple Inc., 2023

A neural processor with a combination of neural engine circuits for specialized neural network computations and planar engine circuits for more general computations. The planar engine circuits can handle a larger number of inputs than the neural engine circuits, and they can efficiently process combined input data by separating and duplicating values. This allows compact storage of multiple inputs and reduces computation cycles for operations involving many sources.

4. Digital System Hardware Accelerators with Independently Power-Gated Local Memory Sections

Apple Inc., 2022

Hardware accelerators in digital systems with local memories that can be power gated to reduce power consumption. The local memory is divided into independently powerable sections. The accelerators receive instructions that specify the amount of memory needed for that instruction. The power control circuit powers on the necessary sections for each instruction while powering off the unused sections to save power. This allows using smaller, lower-leakage local memories while still providing enough memory for each instruction.

5. Multi-Layer Convolution Algorithm with Block-Wise VPU Width Matching for Vector Processors

Apple Inc., 2022

Efficient multi-layer convolution algorithm for vector processors that enables maximizing utilization of the vector processing unit (VPU) for convolution operations on multi-channel input. The algorithm selectively processes blocks of the output in accordance with their width to match the VPU’s width. For blocks that are multiples of the VPU width, it processes each channel separately in the VPU. For smaller width blocks, it processes multiple channels simultaneously in the VPU. This ensures full utilization of the VPU’s data paths. The algorithm involves dividing the output into blocks, determining block width, and assigning blocks to threads that process them using optimized vector instructions for the width.

6. Neural Network-Based Context-Aware Text Prediction System with Separate Context Extraction, Prediction, and Relevance Assessment Networks

Apple Inc., 2023

Generating word and phrase predictions for text completion in digital assistants that provides efficient and intelligent provision of context-relevant text predictions. The method involves using a neural network system to determine text predictions based on both the text being completed and the context surrounding it. This allows the digital assistant to provide context-aware text predictions of varying lengths, improving completion accuracy compared to just predicting words based on the text alone. The neural network system has separate networks for extracting the context, determining text predictions, and assessing relevance.

7. Digital Assistant Interface with Suggested User Input Affordances for Task Discovery and Execution

Apple Inc., 2023

Providing suggested user inputs for triggering digital assistant tasks to help users discover and request useful functions. The digital assistant analyzes user requests for tasks and device content to determine text representations of utterances that can be used to perform the tasks. These suggested utterances are then displayed as affordances on the user interface to allow easy selection and execution of the tasks. The affordances provide a way for users to discover and request tasks they may not know how to ask for, making the digital assistant more accessible and efficient.

8. Digital Assistant with Multi-Stage Contextual Speech Analysis for Continuous Dialog

Apple Inc., 2023

Continuous dialog with a digital assistant that allows more natural and seamless interactions between users and digital assistants. The system uses a multi-stage speech analysis process to handle user follow-up speech, where initial values are analyzed first and then second values are analyzed based on the context. This allows the system to better understand and respond to user requests and follow-up statements. The system also enables users to interrupt and correct the assistant if needed. The multi-stage speech analysis is done by the digital assistant itself, not just relying on speech-related cues.

9. System for Asymmetric Retraining of Machine Learning Models with Input Data Distribution Constraints

Apple Inc., 2023

Allowing asymmetric retraining of upstream and downstream machine learning models without affecting consistency of output. The technique involves specifying constraints on the input data distribution that allow the downstream model to be retrained independently without requiring retraining of the upstream model. The constraints preserve the semantics of the values while allowing the distribution to change over time. This allows the downstream model to adapt to new data without affecting the accuracy of the upstream model’s predictions.

10. Method for Associating Actions with Augmented User Utterances in Natural Language Models

Apple Inc., 2023

Creating and updating natural language models for digital assistants that allows more efficient and accurate interpretation of user requests. The method involves associating actions with user requests, determining augmented utterances based on the original request, and creating the model by mapping the augmented utterances to the associated actions. This allows the model to handle variations and unknown words in new requests. It also involves sharing learned models between applications.

11. Antenna Panel Switching Optimization for Enhanced Downlink Reception in Cellular Devices

Apple Inc., 2023

Enabling cellular devices to efficiently switch antenna panels during downlink reception in wireless communication systems. The technique involves a cell base station compensating for the delay incurred by a device activating an inactive antenna panel before a scheduled transmission. The base station determines the activation delay and adds it to the transmission scheduling offset. This ensures the device has enough time to activate the panel before the scheduled transmission. It allows devices to conserve power by not always keeping all panels active, while still enabling efficient downlink reception with panel switching.

12. Neural Processor Compiler with Local Data Buffer for Minimizing External Memory Access

Apple Inc., 2023

Compiler for neural processors that reduces data fetch and read operations between memory external to the neural processor and the neural engine inside the processor. The compiler stores input, output, and intermediate data in a local data buffer inside the neural processor rather than accessing system memory. This allows more efficient processing by avoiding external memory reads/writes most of the time.

13. Neural Processor Circuit with Integrated Binary Comparator and Dimensional Reduction Engines

Apple Inc., 2023

Neural processor circuit for performing binary comparison and reduction operations in a neural network accelerator without software control. The circuit has a neural engine to perform convolutions and a separate planar engine with a binary comparator and filter. The binary comparator applies Boolean operations to output tensors to generate conditional tensors. The filter reduces dimensions of the conditional tensors to generate channel-wise values. This allows implementing conditional operations and reducing tensor sizes directly in hardware, avoiding software for these tasks.

14. Content Grouping System Using Semantically Equivalent Topic Tags Across Languages

Apple Inc., 2023

Grouping and presenting content items by semantically equivalent topics instead of strict grouping by topic tags to prevent confusion when topic tags are different in different languages. The technique involves determining semantically equivalent topic tags across languages and grouping content items based on these equivalent topics. This allows presenting all politics-related content together regardless of whether the topic tag is “politics” in English or “politique” in French.

15. Neural Network for Unsupervised Grammatical Error Detection and Correction

Apple Inc., 2023

Intelligent detection and correction of grammatical errors in user input using a neural network trained using unsupervised learning. The network takes a set of words with a grammatical error and a reference set of words, transforms the error set using the network, and reconstructs the reference set. Comparing the transformed and reconstructed sets determines if the error set is grammatical. The network is trained without labeled examples by generating error sets, transforming them, and comparing. This allows efficient training of a grammar checker using unsupervised data.

16. Neural Processor with Dual-Mode Tensor Processing and Reduction Circuitry

Apple Inc., 2022

A neural processor with multiple modes for processing large tensors efficiently. The processor has both neural engine circuits for convolution operations and planar engine circuits that support a reduction mode for aggregating tensor values. The planar engines reduce large tensors in multiple cycles and accumulate results in buffers. This allows processing tensors larger than the engine capacity. The reduction mode also has optimized post-processing circuits for common reduction operations.

17. Generative Adversarial Network with Distillation Techniques and Cycle Consistency for Enhanced Prediction on Resource-Constrained Devices

Apple Inc., 2022

Prediction system using generative adversarial network (GAN) and distillation technology to improve prediction accuracy on devices with limited computational resources. The system involves leveraging GAN and distillation techniques like knowledge distillation and probability density distillation to enhance prediction performance. It uses a GAN framework where a student model learns from a teacher model and a cycle consistency loss is added to constrain the mappings. The student output distribution is fed back to the teacher and vice versa for distillation. The GAN-distillation combined approach provides better prediction accuracy compared to using GAN or distillation alone.

18. Federated Learning System with Dual Prediction Techniques for Ground Truth Identification

Apple Inc., 2022

Federated learning technique that uses a second prediction technique on local devices to identify ground truth data for updating the centrally-stored machine learning model. The second prediction technique is more accurate but less real-time than the first technique used on the model. By generating predictions using both techniques on local data, ground truth can be determined without requiring user input. This improves federated learning for scenarios like image classification where ground truth is not readily available.

19. Neural Processor Circuit with Task Manager and Buffered Context Switching Mechanism

Apple Inc., 2022

A neural processor circuit for efficient context switching between tasks in neural network processing. The circuit has a data processor with a buffer to store output data. A task manager sends configuration data to the data processor during context switch. The configuration includes masks to transfer outgoing task data from the buffer to external memory and fetch incoming task data. This allows swapping out unrelated intermediate outputs between tasks without copying all data.

20. Adversarial Discriminative Adaptation for User-Specific Language Model Updates with Constrained Probability Distribution

Apple Inc., 2022

Efficiently updating a language model using adversarial discriminative adaptation to accurately reflect individual user idiosyncrasies without requiring large amounts of user data. The technique involves training a first language model using user data and then storing a reference version with the overall probability distribution. A second language model is trained using new user data, but constrained by the reference version’s probability distribution. This updates the second model with the user’s idiosyncrasies while preventing it from diverging too far.

21. Machine Learning Node with Parameterized Logical Representation of Fixed Function Node for End-to-End Training

22. Neural Network Architecture with Gating and Pooling for Linear Complexity Sequence Processing

23. Language Model-Based Sentence Embeddings with Vector Space Representation for Natural Language Processing Tasks

24. Method for Validating Language Models via Comparative Analysis of Privacy-Preserving Training Effects

25. Inter-Pipeline Operand Routing Circuitry for SIMD-Based Matrix Computation

Get Full Report

Access our comprehensive collection of 31 documents related to this technology